Lead Data Platform Engineer

Who We Are:
 

Machinify is a leading healthcare intelligence company with expertise across the payment continuum, delivering unmatched value, transparency, and efficiency to health plan clients across the country. Deployed by over 60 health plans, including many of the top 20, and representing more than 160 million lives, Machinify brings together a fully configurable and content-rich, AI-powered platform along with best-in-class expertise. We’re constantly reimagining what’s possible in our industry, creating disruptively simple, powerfully clear ways to maximize financial outcomes and drive down healthcare costs.
 

Location: Remote
 

About the Role: 

We are seeking an experienced Lead Data Platform Engineer with a focus on big data systems, orchestration, and ETL processes. In this role, you will architect and implement scalable data infrastructure using both existing and greenfield systems. You will collaborate with cross-functional teams to ensure our data solutions meet business needs and leverage cloud-native tools for optimal performance. 

What You’ll Do: 

• Develop scalable and observable data platforms tailored to business needs. 

• Build and manage systems in cloud environments using AWS and Azure. 

• Collaborate with data scientists, engineers, and experts to deliver right-fit solutions while increasing data quality and ease-of-use. 

• Ensure data systems are reliable, flexible, and scalable for large datasets from diverse sources (batch vs event, on-prem vs cloud, etc) 

• Architect and build reusable data pipeline and DAG systems. 

• Create and deploy Kubernetes-based systems in cloud-native environments. 

• Support machine learning workflows through data modeling and transformation. 

• 5+ Years in software development with Python and SQL. 

• Strong understanding of ETL processes, big data pipelines, and relational databases (PostgreSQL, SQL Server, etc.). 

• Experience with orchestration tools (e.g., Airflow, Prefect, Dagster). 

• Knowledge of cloud platforms (AWS, Azure, GCP) and their ecosystem tools. 

• Strong problem-solving skills and clean coding practices. 

• Experience with Apache Spark or similar technologies. 

• Experience with agentic coding workflows. 

• Experience with data modeling, transformation, and integration. 

• Experience with data quality, lineage, and modeling tools. 

Preferred Technical Skills: 
 

• Experience in software development with Golang. 

• Experience with managed data lake systems (e.g., Databricks, Snowflake, AWS Redshift). 

• Familiarity with Kubernetes and container orchestration (Docker, Helm, etc.). 

• Familiarity with infrastructure-as-code systems (e.g., Terraform, Ansible) 

• Knowledge of monitoring and logging tools for distributed systems (Prometheus, Grafana, ELK stack). 

• Experience with CI/CD pipelines and automated testing. 

• Strong understanding of data modeling, ETL workflows, and data transformation techniques. 

Pay range: $185,000-$200,000 USD  

This is an exempt position.  The salary range is for Base Salary. Compensation will