Lead Data Platform Engineer

ECS is seeking a Lead Data Platform Engineer to work in our Fairfax, VA office.

 

Position Overview:

ECS is seeking a Lead Data Platform Engineer to support the development of a next-generation data management platform focused on Artificial Intelligence/Machine Learning (AI/ML) and Big Data/Cloud Solutions. This is not a project management role; however, it requires strong leadership and hands-on technical expertise in areas such as cloud architecture, data engineering, and compliance. The candidate will collaborate closely with the Project Manager and a cross-functional team of engineers and scientists to design, build, and deploy a scalable platform that ingests data from multiple sources, performs ETL operations, and produces curated datasets for AI/ML training. The ideal candidate fosters a culture of innovation, collaboration, and technical excellence in a mission-driven environment.

 

Position Description:

The Lead Data Platform Engineer will define the technical vision and lead the design and implementation of a secure, scalable, and compliant data management platform incorporating a mix of COTS and open-source components. This individual will partner with the Project Manager to guide a multidisciplinary team including data engineers, data scientists, DevSecOps specialists, cloud engineers, and cybersecurity professionals.

 

Key responsibilities include:

• Leading the design and deployment of AWS-based environments to support IL5/IL6 requirements.
• Building and managing data pipelines using Databricks, Apache Spark, and related ETL technologies (e.g., AWS Glue, Apache Airflow).
• Ensuring compliance with DoD security and accreditation standards, including STIGs and Impact Level controls.
• Providing architectural oversight on data ingestion, curation, and storage to produce reliable, high-quality datasets for AI/ML vendors.
• Supporting DevSecOps practices, CI/CD pipelines, and automation to streamline delivery.
• Acting as the primary technical interface with project stakeholders, ensuring alignment between technical execution and mission needs.

This role blends hands-on technical work and architectural leadership, with direct involvement in solution design, prototyping, and technical decision-making.

Qualifications

• Active Secret clearance and eligible for a Top-Secret Clearance with the capability of obtaining SCI / CI-Poly to meet contract requirements.
• 10+ years of experience in software engineering, data engineering, or cloud architecture.
• Strong expertise with AWS cloud services (compute, storage, networking, IAM).
• Proficiency with Linux Environments (system administration, scripting, troubleshooting).
• Hands-on experience with Databricks and Apache Spark for large-scale data processing.
• Proficiency in building and managing ETL pipelines (e.g. AWS Glue, Apache Airflow).
• Strong understanding of data engineering principles, including data ingestion, transformation, and curation workflows.
• Proficient in Python, Bash, or equivalent scripting/programming languages used in cloud and data environments.
• Experience implementing CI/CD pipelines and modern DevSecOps workflows.
• Demonstrated ability to work in a fast paced matrixed, multidisciplinary team environment.
• Strong communication skills with the ability to interface and collaborate with project managers, stakeholders, vendors, and technical staff.