Senior Software Development Engineer, Big Data

About the team

The Transactions Data Warehouse team at Zillow is a member of the Analytics Data Engineering organization and works closely with product, analytics, and AI teams. Your work will have a direct impact on the design and implementation of data engineering solutions that improve the efforts of our AI, Marketing, and Data Science teams, thus enhancing Zillow's offerings for customers. This dedicated team is vital in supporting Zillow's Premier Agent, Agent Software and Advertising, and Zillow Home Loans business areas.

About the role

The Senior Software Development Engineer, Big Data role at Zillow presents an outstanding opportunity to be at the forefront of brand-new data engineering work. Your day to day responsibilities will include the following:

• Design and implement scalable data pipelines to collect, process, and store large volumes of critical data from various sources.

• Provide data reliability and uptime by monitoring and troubleshooting data pipeline performance and scalability to ensure efficient operations.

• You are a “lazy” engineer - continuously seeking to improve the team’s efficiency by automating repeatable processes.

• Facilitate engineering discussions with collaborators, customers, partners, and team members from various departments to understand business needs and convert them into technical requirements.

• You are a fast learner with strong business insight and can collaborate with various product partners to quickly acquire a deep understanding of the business processes that feed into our team’s data pipelines

• Authoritatively translate business use cases into well-thought-out data models that are easy to evolve with the business.

• Communicate technical concepts effectively to non-technical audiences.

• You are a bar-raiser for engineering best practices - carefully reviewing specifications, designs, pull requests and providing constructive/helpful feedback to raise the quality of our team’s output

• Consistently write high-quality code, refactor, and optimize for better scalability, performance, and readability.

• Provide leadership within the team and mentor junior engineers.

• Provide leadership within the team and mentor junior engineers. 

In addition to a competitive base salary and benefits, this position is also eligible for equity awards based on factors such as experience, performance and location.

This role has been categorized as a Remote position. “Remote” employees do not have a permanent corporate office workplace and, instead, work from a physical location of their choice, which must be identified to the Company. U.S. employees may live in any of the 50 United States, with limited exceptions.

In California, Colorado, Connecticut, Hawaii, Illinois, Maryland, Massachusetts, Minnesota, Nevada, New Jersey, New York, Rhode Island, Vermont, Washington state, and Washington DC the standard base pay range for this role is $158,200.00 - $252,800.00 Annually. This base pay range is specific to California, Colorado, Connecticut, Hawaii, Illinois, Maryland, Massachusetts, Minnesota, Nevada, New Jersey, New York, Rhode Island, Vermont, Washington state, and Washington DC and may not be applicable to other locations.

In addition to a competitive base salary this position is also eligible for equity awards based on factors such as experience, performance and location. Actual amounts will vary depending on experience, performance and location.

Who you are

• A degree (BS+) in Computer Science or a related field

• 5+ years of experience building and maintaining data-intensive applications.

• Experience developing sophisticated data pipelines scaling to billions of rows with production quality deployment, monitoring and reliability

• Extensive experience with modern data technologies such as Spark, Flink, Kafka, and Airflow.

• Strong proficiency in programming languages such as Python, Java, or Scala.

• Extensive experience with SQL

• Proven data modeling experience, translating business requirements into clean and easily evolvable data models.

• Excellent interpersonal skills and a passion for collaborating across organizational boundaries.

Nice to have:

• Experience working with cloud services (AWS/Azure/GCP)

• Experience with Da