Senior Data Engineer

Location: Austin, TX | San Carlos, CA | Remote (US)

Position Summary

The Senior Data Engineer plays a crucial role in designing and developing enterprise-scale data engineering solutions, ensuring businesses have access to the data they need for informed decision-making. This position focuses on building robust data infrastructure capable of processing large-scale datasets while integrating machine learning capabilities into production data workflows.

Key Responsibilities

• Understand business requirements, processes, and data sources to design appropriate technical solutions

• Collaborate with business analysts to translate data requirements into logical data models and scalable architectures

• Design and implement highly scalable ETL processes and data transformations for >100 GB-scale data warehousing environments

• Develop and optimize SQL views, procedures, and functions across multiple database platforms

• Serve as subject matter expert in Structured Query Language (SQL) and database performance optimization

• Analyze and process complex data with large volumes using distributed computing frameworks

• Ensure the integrity and quality of data stored in data warehouses and data marts

• Build and maintain machine learning pipelines for model training, validation, and deployment

• Collaborate with data scientists and AI engineers to integrate AI/ML pipelines into data workflows

Required Qualifications

Education & Experience

• Bachelor's degree in Computer Science or equivalent experience

• 8+ years of overall software development experience, preferably building complex data solutions

• Minimum 5 years of experience working with several SQL platforms (Redshift, Athena, MySQL/Postgres, Snowflake, BigQuery)

• Minimum 3 years of experience working with PySpark and Iceberg tables / Parquet files

• Ability to lead a team of data engineers

Core Data Engineering Skills

• Big Data Processing: Extensive experience with Apache Spark and PySpark for large-scale data processing and 100+ GB scale data warehousing

• Modern Data Lakehouse: Proficiency with Apache Iceberg for managing large-scale table formats and data lake architectures

• Experienced with data warehouse applications

• Experience with data pipeline orchestration tools such as Apache Airflow

• Experienced with data visualization tools such as Power BI, Qlik Sense, Tableau, QuickSight, Looker, or similar

AI/ML Expertise Nice to have

• Familiarity with machine learning frameworks (e.g., TensorFlow, PyTorch) and libraries (e.g., scikit-learn)

• Experience implementing AI/ML models for data processing, predictive analytics, and anomaly detection

• Experienced in leveraging large language models (LLMs) during development (e.g. Cursor) and used within applications

• Ability to collaborate with data scientists and AI engineers to integrate AI/ML pipelines into data workflows

Additional Technical Skills

• Strong programming proficiency in Python and SQL

• Understanding of bioinformatics / genomics (e.g. secondary and tertiary analysis tooling) and file format standards (e.g. VCF, BAM, FASTQ)

• Experience with distributed computing and cluster management

• Understanding of data quality, governance, and monitoring practices

 

The pay range is listed and actual compensation packages are based on a wide array of factors unique to each candidate, including but not limited to skill set, years & depth of experience, certifications and specific office location. This may differ in other locations due to cost of labor considerations.Remote USA$103,200—$128,950 USD

OUR OPPORTUNITY

Natera™ is a global leader in cell-free DNA (cfDNA) testing, dedicated to oncology, women’s health, and organ health. Our aim is to make personalized genetic testing and diagnostics part of the standard of care to protect health and enable earlier and more targeted interventions that lead to longer, healthier lives.

The Natera team consists of highly dedicated statisticians, geneticists, doctors, laboratory scientists, business professionals, software engineers and many other profes