Data Engineer - Consultant

Location:  Remote (Anywhere Canada)

Contract Duration: 12 months ( with a possibility of extension )

Required Experience:

• Consulting with business units to properly define business problem and identify pattern/solution that will resolve the issue.
• Consulting with data engineering to ensure solutions are within 'rules' (follow approved patterns) and develop new patterns when necessary.
• Experience training BIA, Data Analysts and Data Scientists.

Required Skills:

• Experience working with Amazon Web Services (AWS) infrastructure and technologies; DMS, Glue, Step Functions
• Ability to train AWS tech – Quicksite, Redshift, Sagemaker, Glue
• AWS Glue/Spark (PySpark + Spark 3.52)
• Python 3.11
• QuickSight and Analytic UI/UX
• AWS Step Functions & AWS CDK
• SageMaker + SageMaker Pipelines
• DataOps approaches
• Version Control + CI/CD Toolsets (Git, AWS CodeBuild, AWS Code Pipeline)
• Ability to train on building access layer in AWS 
• Ability to provide information about of data pipeline
• Ability to map tech debt (SAS, PowerBI, Tableau, etc) to AWS Solutions
• Ability to train on Data Observability Framework (DataHub)
• Ability to train on GIS
• Technical Writing

 Description of Duties:

• Consultants will work with business units comprised of Data Analysts, Business Intelligence Analysts and Data Scientist to execute an adoption plan to migrate existing data assets and process into AWS, including applying the Data Observability Framework. 
• The consultants will provide the ongoing support post migration and for the business units developing of new solutions.
• The support will include identifying the needs of each business unit and training on the approved patterns needed to fully enable them.
• It will also include identifying gaps in the approved patterns and then working with Data Engineering to close those gaps with new patterns, or a process optimization unit if needed.

Datavail is a leading provider of data management, application development, analytics, and cloud services, with more than 1,000 professionals helping clients build and manage applications and data via a world-class tech-enabled delivery platform and software solutions across all leading technologies. For more than 17 years, Datavail has worked with thousands of companies spanning different industries and sizes, and is an AWS Advanced Tier Consulting Partner, a Microsoft Solutions Partner for Data & AI and Digital & App Innovation (Azure), an Oracle Partner, and a MySQL Partner.