Data Engineer/Software Engineer

In a world of possibilities, pursue one with endless opportunities. Imagine Next!

When it comes to what you want in your career, if you can imagine it, you can do it at Parsons. Imagine a career working with exceptional people sharing a common quest. Imagine a workplace where you can be yourself. Where you can thrive. Where you can find your next, right now. We’ve got what you’re looking for.

Job Description:

Join Us in Powering the Future of AI within Cyberspace

We are seeking a Senior Data Engineer to help build and optimize the backbone of advanced AI systems. This role offers an opportunity to work on cutting-edge AI integration projects, developing high-performance data pipelines, ensuring seamless data flow, and enabling AI-driven decision-making. If you enjoy solving complex data challenges and collaborating with top-tier data scientists and software engineers, this is the role for you.

Job Description

As a Senior Data Engineer, you will be responsible for designing, building, and optimizing scalable data pipelines that support AI-driven analytical systems. This position involves developing and managing data models, automating ETL processes, optimizing data indexing and retrieval, and working closely with AI/ML teams to structure and store data effectively. The ideal candidate will have experience with Postgres (UDFs, SQL Triggers), Spark, Ray, ElasticSearch, Python, AWS S3, and structured data formats (Parquet, Avro, JSON Schema).

This hybrid role requires candidates to be local to Maryland, Northern Virginia, or the DC Metro area for occasional on-site collaboration.

Key Responsibilities

• Data Modeling and Management – Design, develop, and maintain data models throughout their lifecycle. Collaborate with various stakeholders on requirements and their realization.

• Data Transformation and Pipelines – Transform raw data from a number of different system and automate ETL pipelines to support AI-driven analytics and machine learning applications as well as log retrieval and metric analysis

• Indexing and Retrieval – Collaborate with teams to provide data indexing and retrieval using ElasticSearch or SOLR and related technologies.

• Collaboration with AI/ML Teams – Work with an AI team to identify data to capture and store for future analysis and refinement. Support AI activities and suggest data structures and models capable of supporting their work.

• Data Governance – Ensure data quality throughout its lifecycle using Triggers, User-Defined Functions (UDFs), and Spark. Handle large data streams with different transformation requirements.

• Cloud Data Management – Leverage cloud services such as AWS S3 and other cloud-based solutions for optimizing costs and secure data storage.

Required Qualifications

• U.S. Citizenship with an active Secret clearance and ability and willingness to obtain a TS/SCI.

• Bachelor’s degree in Software Engineering, Computer Science, Information Systems, or a related field. Four additional years of experience may be substituted in lieu of a degree.

• Minimum of five years of experience in back-end software development with a focus on data engineering.

Technical Skills

• Strong experience with SQL 2023, Postgres 15/16/17, including UDFs and Triggers.

• Expertise in ETL processes, data modeling, and data transformation.

• Proficiency in working with structured and semi-structured data formats (Parquet, Avro, JSON Schema) along with various schema description formats.

• Skilled in Python for scripting and data manipulation. Familiarity with other languages such as Java and Scala would be beneficial.

• Experience with Hadoop, Spark/PySpark and Ray for large-scale data processing.

• Hands-on expertise with ElasticSearch and/or SOLR for indexing and retrieval of massive datasets.

• Familiarity with HBase, Accumulo, Impala, AWS S3 and cloud-based storage solutions.

• JSON Schema and XML Schema design and enforcement.

Preferred Qualifications

• TS preferred.

• Ability to communicate highly technical analyses to non-technical audiences, including senior government representatives and executives.

• Experience with database architecture, UX, and software development/deployment tools such as Git, Artifactory, and SonarQube.

• Experience working in Agile/SAFe development environments.

• Background in modeling and processing large datasets.

Security Clearance Requirement

• Minimum Clearance Required: Secret

Security Clearance