Senior Software Development Engineer (ML/AI Focus) for the Housing Trends Data Engineering Team

About the team

The Zillow Group’s Housing Trends Data Engineering team brings innovative analysis, creativity, and excellence to the U.S. housing market. We create, productionalize, analyze, and share a full collection of housing metrics and analysis for Zillow’s internal and external customers. Our work contextualizes Zillow’s unparalleled living database of all homes and hundreds of millions of customers to provide insight to everyday consumers and open data to hundreds of researchers and policymakers across the country. You’ll work in a fun, collaborative atmosphere with a high-performance team with diverse data engineering and analytical skills.

Your work will be highly impactful. The data we create ends up in the nation’s most reputable publications, used by government institutions in policy-making and official reports, in public-facing tools used by millions of Zillow consumers, and in the work of hundreds of academic researchers.

Small team = big impact. Engineering teams are highly decentralized in order to create the small team speed and autonomy of a start-up environment but are backed by big company resources.

About the role

We process hundreds of millions of data points to produce macroeconomic housing market indicators, forecasts, and insights. We publish those so businesses, policymakers, and individuals can make informed decisions about homes. We are also an integral part of housing market intelligence for our internal businesses, and an important input into tactical and strategic business decisions with customers across the company (from marketing, finance, business unit ML teams, to executives).

We are looking for a strong engineer who will be working closely with the data science and forecasting teams, and our customers to help us re-shape our rapidly-evolving data products and the end-to-end data processing framework. You will have great opportunities to learn cutting-edge ecosystems, and cloud technologies, and work with a group of versatile software developers in a collaborative and supportive team environment.
 

You will:

• Build data systems to link raw data and concrete Housing Trends insights.
• Build and extend our internal forecasting model development framework.
• Develop and maintain scalable data products and deliver pipelines built for speed, accuracy, and consistency that will scale as our stakeholders’ need. 
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability and performance, etc.
• Collaborate with data scientists to understand their data requirements and build systems/tools that enable efficient model training and experimentation.
• Implement feature stores and ETL pipelines to streamline feature engineering and model development.
• Build and maintain infrastructure for deploying machine learning models into production environments.
• Be a trusted partner for our stakeholders, such as Forecasting, Zestimates, and the ML teams within the AI organization to assist them for data investigation/publication, ML model development and infrastructure support.
   

This role has been categorized as a Remote position. “Remote” employees do not have a permanent corporate office workplace and, instead, work from a physical location of their choice, which must be identified to the Company. U.S. employees may live in any of the 50 United States, with limited exceptions.

In California, Colorado, Connecticut, Hawaii, Illinois, Maryland, Minnesota, Nevada, New York, Washington state, and Washington DC the standard base pay range for this role is $158,200.00 - $252,800.00 Annually. This base pay range is specific to California, Colorado, Connecticut, Hawaii, Illinois, Maryland, Minnesota, Nevada, New York, Washington state, and Washington DC and may not be applicable to other locations.

In addition to a competitive base salary this position is also eligible for equity awards based on factors such as experience, performance and location. Actual amounts will vary depending on experience, performance and location.

Who you are

• Proficiency in Python, Spark, SQL, and Hive programming for data analytics and ETL pipeline development.
• Experience building systems on AWS cloud platforms is required.
• Hands-on expertise with big data ecosystems and platforms, including Spark, EMR, EKS, Hive, Hadoop, Presto, Kubernetes and Airflow. 
• Hands-on experience with Lakehouse technologies such as Databricks and Delta Lake is a significant advantage.
• Familiarity with Agile/DevOps software development processes and tools such as GitLab and CI/CD.
• Demonstrated experience in building and orchestrating batch and