Sr Data Engineer

Job Family:

Software Development & Support (Digital)

Travel Required:

Up to 10%

Clearance Required:

None

What You Will Do:
 

The Data Engineer will work closely with clients, digital leaders, solutions architects and technical/functional leads across Guidehouse digital teams and market segments to support client projects and provide solutions for growth efforts and capabilities build out.

• Serve as a key member of the data team to support technical challenges/demos, building innovative data solution prototypes using modern data architectures and processing technologies.

• Solutions architecture and hands-on engineering of scalable and secure distributed data systems using modern data technologies, cloud-native data services, data lake/warehouse architecture, and streaming data processing patterns.

• Work collaboratively with data scientists, analytics engineers, platform engineers, product owners, solution architects, and business analysts to design, build, test, and deploy high-value, operationally resilient data products and pipelines that satisfy functional and non-functional requirements.

• Support data migrations and modernization including migration from legacy data systems to modern cloud-based data platforms and real-time analytics architectures.

What You Will Need:

• Bachelor's degree , Additional Four (4) years of exo will be needed in lieu of degree.

• 6+ years of prior relevant experience in data engineering and data pipeline development

• 3+ years of experience with cloud data platforms to build/modernize data systems and analytics solutions

• Proven ability to work autonomously and collaborate, mentor, help, and support other team members, as needed to solve complex data engineering problems.

• Proven ability to develop data solution prototypes and use prototypes to validate technical solution strategies and communicate and explain the pros and cons of complex data architecture alternatives.

• An in-depth understanding of the Agile and Scaled Agile practices and principles experience. Must be an experienced Agile practitioner with proven ability to plan and implement data products with agility.

• Experience and proficiency implementing data pipelines and analytics solutions including:

  • Programming Languages: Python, SQL, Scala, Java

  • Big Data Technologies: Apache Spark, Hadoop, Kafka, Airflow, Snowflake

  • Cloud Data Services: AWS (S3, Redshift, Glue, EMR, Kinesis) or Azure (Data Factory, Synapse, Event Hubs), or GCP (BigQuery, Dataflow, Pub/Sub)

  • Data Warehousing: Snowflake or Redshift, BigQuery, Synapse Analytics

  • Databases: DB2 or PostgreSQL, MySQL, MongoDB, Cassandra, Elasticsearch

  • Streaming Technologies: Apache Kafka, AWS Kinesis or Azure Event Hubs, Apache Storm

  • Containerization: Docker or Kubernetes, container orchestration for data workloads

  • Data Formats: Parquet, Avro, JSON, ORC, Delta Lake

• Familiarity with data modeling techniques (dimensional modeling, data vault) and proven data architecture patterns (Lambda, Kappa, medallion architecture) required, as is the ability to design and build cloud-based data products that conform with data governance and security best practices.

• This is a hands-on data engineering position and requires the ability to proficiently and predictably build and deploy custom data pipelines and analytics solutions in cloud environments.

• Proven ability to design, build, test, and deploy data products and solutions on cloud data platforms.

• Excellent written and verbal communication skills with an ability to handle customer requirements and engineer data solutions.

• US Citizenship, Green Card Holder or Green Card EAD will be needed.

• Ability to obtain public trust clearance

What Would Be Nice To Have:

• AWS Certified Data Analytics – Specialty or Azure Data Engineer Associate or Google Professional Data Engineer or Snowflake Certification

• Real-time analytics and streaming data processing

• Data governance and lineage tools (Apache Atlas, DataHub, Collibra)

• Experience with data quality frameworks and testing methodologies for data pipelines

• Experience in the Financial Services industry preferred

What We Offer:

Guidehouse offers a comprehensive, total rewards package that includes competitive compensation and a flexible benefits package that reflects our