Data Engineer (5061)

SMX is seeking a Data Engineer to provide support for the NAWCAD Readiness & Fleet Analytics (R&FA) Division’s Advanced Analytics and Innovation (AA&I) Branch at Patuxent River Naval Air Station in Lexington Park, MD.   This Data Engineer will primarily involve migrating code for data science projects from Cloudera Data Science Workbench (CDSW) to Databricks. The candidate will design, build, and maintain robust data pipelines and architectures that support advanced analytics and decision-making across the Naval Aviation Enterprise. The candidate will focus on data engineering tasks, including data extraction, transformation, and loading (ETL), database management, and optimizing data workflows. Your work will directly support Program Management Air (PMA) offices, Air Systems Group, Command, Fleet Readiness Centers, and other Department of Defense (DoD) services.   As a Data Engineer, you will leverage Python, SQL, and cloud-based platforms to ensure the seamless flow of data between systems and applications. You will play a critical role in enabling data-driven solutions by ensuring data integrity, scalability, and accessibility for analytics teams and stakeholders. This is a full-time position with telework as the standard arrangement, complemented by occasional in-office requirements.

Essential Duties & Responsibilities

• Code Migration & Translation
  
  • Migrate existing HiveQL and Python-based workflows from Cloudera Data Science Workbench (CDSW) to Databricks.
  • Translate existing workflows to the new environment while ensuring results are consistent or improved in terms of performance, scalability, and data quality.
  • Refactor and optimize code to leverage Databricks features and capabilities effectively.
  • Collaborate with analytics teams to validate migrated workflows and ensure functionality aligns with project requirements.
• Cloud-Based Data Engineering
  
  • Leverage cloud platforms such as AWS, Databricks, or similar tools to manage and process large-scale datasets.
  • Implement CI/CD workflows for data engineering projects to streamline development and deployment.
• Data Pipeline Development
  
  • Design, develop, and maintain ETL pipelines to extract, transform, and load data from various sources into centralized databases or data warehouses.
  • Automate data workflows and processes to ensure efficient and reliable data delivery.
  • Optimize data pipelines for scalability, performance, and fault tolerance.
• Database Management
  
  • Build and manage relational and non-relational databases to support analytics and reporting needs.
  • Write and optimize complex SQL queries for data extraction and manipulation.
  • Ensure data integrity, security, and accessibility across all systems.
• Collaboration & Support
  
  • Work closely with stakeholders, including product owners and analytics teams, to understand data requirements and deliver solutions that meet business needs.
  • Provide technical guidance and support to team members on data engineering best practices.

Required Skills & Experience 

• Clearance Required: Secret
  • US Citizenship is required for work on DoD contract
• A Bachelor’s degree in Computer Science, Data Engineering, Information Systems, or a related field
• 5+ years of related academic or professional experience
• Proficiency in Python and SQL, with hands-on experience in developing ETL pipelines and managing databases.
• Experience with cloud platforms such as AWS, Databricks, or similar tools.
• Strong understanding of relational and non-relational database systems.
• Proven experience migrating workflows and code from legacy platforms (e.g., CDSW) to modern cloud-based environments (e.g., Databricks).
• Ability to translate existing workflows to new environments while ensuring results are consistent or improved in terms of performance and data quality.
• Proficiency in HiveQL and Python for data engineering tasks.
• Proficiency in GitLab and JIRA for project management and version control.
• High-level problem-solving and interpersonal skills.
• Flexible and able to work effectively in dynamic environments.
• Strong oral and written communication skills, including the ability to interact professionally across all levels of management.
• Proven ability to work collaboratively with cross-functional teams to deliver data solutions.

Desired Skills/Experience: 

• Experience with Tableau, Qlik, or Power BI for creating advanced visualizations and interactive dashbo