Cloud Data Engineer

3+ years of expertise in building scalable distributed data processing solutions with Azure Data Lake Storage and Azure Synapse Data Warehouse, understanding of the functionalities - Identity Management, Security, Data Governance, DevOps, and Operations on Azure Platform. Expert in managing data models, Pyspark and Python code, data pipelines, data load failure issues, and optimization of existing ML spark jobs for better performance.

Skills and Abilities: 

Ability to:

- Build and manage Data Pipelines

- Build and manage data models

-  MS Fabric/Azure Synapse/Data Factory

-  Azure Data Lake Storage /ADLS Gen2

-  Oracle PL/Sql, TSQL (Queries, Functions, Stored Procedures)

- Python and Pyspark

 

Knowledge:

- Python, Pyspark

- Azure DevOps

 

Minimum Education and Certification:

- Bachelor's degree

 

Minimum Experience:

- 3+ years of IT and Data Warehouse experience

 

Leadership:

 

- Customer-focused professional who is motivated to drive the creation of great data engineering platforms.  

- Contribute to the continued evolution of Corporate Analytics Platform

- Responsible for managing a growing cloud-based data ecosystem.

 

Problem Solving and Innovation:

- Ability to define and create complex data models to build insights, predictions, and innovations from data.

- Expected to identify opportunities and to provide ideas, methods and innovations to enhance teamwork, efficiency and quality.

This job description is a summary of essential job functions.  It is not intended as an employment contract, nor is it intended to describe all duties someone in this position may perform.  All employees are expected to perform tasks, as assigned by supervisor, regardless of job title or routine job duties.

3+ years of expertise in building scalable distributed data processing solutions with Azure Data Lake Storage and Azure Synapse Data Warehouse, understanding of the functionalities - Identity Management, Security, Data Governance, DevOps, and Operations on Azure Platform.

Expert in managing data models, Pyspark and Python code, data pipelines, data load failure issues, and optimization of existing ML spark jobs for better performance.

Archrock is a premier provider of natural gas compression services to customers in the energy industry throughout the U.S. and a leading supplier of aftermarket services to customers who own compression equipment. With approximately 1,000 employees, our unmatched expertise and team of highly qualified, certified technicians are backed by more than 70 years of industry experience.
Archrock is an Equal Opportunity Employer and gives consideration for employment to qualified applicants without regard to race, color, religion, age, sex, sexual orientation, gender identity, national origin, disability, or protected veteran status.