Sr. Data Engineer

Job Title: Sr. Data Engineer

Job Category: Information Technology

Time Type: Full time

Minimum Clearance Required to Start: Secret

Employee Type: Regular

Percentage of Travel Required: Up to 10%

Type of Travel: Local

* * *

The Opportunity:

CACI is seeking a talented Sr. Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data engineering and experience in designing, implementing, and maintaining robust pipelines. This role requires deep understanding of data architecture, data warehousing, ETL processes and big data technologies. The Sr. Data Engineer will work closely with data scientists, analyst, and other stakeholders to ensure the seamless flow and integrity of data across the organization.

***This position requires onsite presence 4 days a week.***

Responsibilities:

• Build, maintain, and optimize data pipelines for extracting, transforming, and loading (ETL) data from various sources into our data warehouse.

• Integrate large, complex data sets that meet functional and non-functional business requirements.

• Design and implement scalable and reliable data warehousing solutions.

• Extract data from various sources, transform it into a usable format, and load it into Azure data storage solutions such as Azure Data Lake Storage, Azure SQL Database, or Azure Synapse Analytics.

• Develop and maintain data pipelines using Azure Data Factory and other relevant Azure technologies.

• Manage and optimize databases, ensuring data quality, integrity, and security.

• Automate manual processes, optimize data delivery, and re-design infrastructure for greater scalability.

• Collaborate with data scientists, analysts, and other stakeholders to understand data needs and deliver high-quality data solutions.

• Document data flows, processes, and system architecture to ensure clarity and knowledge sharing within the team.

Qualifications:

Required: 

The Opportunity:

CACI is seeking a talented Sr. Data Engineer to join our dynamic team. The ideal candidate will have a strong background in data engineering and experience in designing, implementing, and maintaining robust pipelines. This role requires deep understanding of data architecture, data warehousing, ETL processes and big data technologies. The Data Engineer will work closely with data scientists, analyst, and other stakeholders to ensure the seamless flow and integrity of data across the organization.
***This position requires onsite presence 4 days a week.***

Responsibilities:
Build, maintain, and optimize data pipelines for extracting, transforming, and loading (ETL) data from various sources into our data warehouse.

Integrate large, complex data sets that meet functional and non-functional business requirements.

Design and implement scalable and reliable data warehousing solutions.

Extract data from various sources, transform it into a usable format, and load it into Azure data storage solutions such as Azure Data Lake Storage, Azure SQL Database, or Azure Synapse Analytics

Develop and maintain data pipelines using Azure Data Factory and other relevant Azure technologies

Manage and optimize databases, ensuring data quality, integrity, and security.

Automate manual processes, optimize data delivery, and re-design infrastructure for greater scalability.

Collaborate with data scientists, analysts, and other stakeholders to understand data needs and deliver high-quality data solutions.

Document data flows, processes, and system architecture to ensure clarity and knowledge sharing within the team.

 
 

Qualifications:

Required:

• An active DoD Secret clearance.

• BA/BS in Computer Science, Information Technology, Data Analytics, or related field.

• 7+ years of related experience.

• Strong experience in data extract transform load (ETL) processes using Azure services, such as Azure Data Factory, Azure Databricks, Azure Data Lake Storage, Azure SQL Database, or Azure Synapse Analytics.

• 6+ years’ experience and skill writing coding languages (such as SQL, Python, R, SAS, and Java Scripts).

• 4+ years’ experience working with projects involving machine learning, natural language processing, robotics process automation, artificial intelligence, text and/or data mining, as well as statistical and mathematical methods.

• Experience with using SQL to conduct complex database queries.

• Experience with AI/ML.

Desired:

• 4+ years of experience working within the D