Staff Data Engineer, Offline Data Infrastructure & Central Data

Airbnb was born in 2007 when two Hosts welcomed three guests to their San Francisco home, and has since grown to over 4 million Hosts who have welcomed more than 1 billion guest arrivals in almost every country across the globe. Every day, Hosts offer unique stays and experiences that make it possible for guests to connect with communities in a more authentic way.

The Community You Will Join:

We are looking for a talented Data Engineer to join our Data Platform organization to help us design and develop scalable and efficient data infrastructure and pipelines. In this role, you will work with cross-functional teams to develop and implement cost data ETL pipelines & metrics.

The Difference You Will Make:

• Collaborate with stakeholders to understand business requirements and translate them into technical solutions within Airbnb’s Offline Data Platform.
• Design, build, and maintain large-scale, distributed data processing systems and pipelines to ensure efficient and reliable data ingestion, storage, transformation, and analysis.
• Develop scalable, fault-tolerant, and performant software components and frameworks for data processing and analytics.

A Typical Day: 

• Optimize and tune data pipelines and infrastructure to enhance overall system performance, reliability, and scalability.
• Evangelize high quality software engineering practices towards building data infrastructure and pipelines at scale.
• Design our data models for optimal storage and retrieval and to meet critical product and business requirements. Understand and influence logging to support our data flow, architecting logging best practices where needed.
• Identify and address data quality and integrity issues through data validation, cleansing, and data modeling techniques.
• Implement robust monitoring, alerting, and logging mechanisms to ensure the health and high availability of our data infrastructure and its pipelines.
• Stay up to date with emerging technologies, best practices, and industry trends in data engineering and software development. Mentor and provide guidance to junior data engineers, fostering their technical growth and professional development. 

Your Expertise:

• Proven track record of at least 9 years as a data engineer or software engineer, with a strong focus on large scale data processing and analytics.
• Deep understanding of software engineering principles, including object-oriented and functional programming paradigms, design patterns, and code quality practices.
• Proficiency in at least one programming language commonly used within Data Engineering, such as Python, Scala, or Java. Familiarity with SQL and NoSQL databases, data modeling, and query optimization.
• Experience with distributed processing technologies and frameworks, such as Hadoop, Spark, Kafka, and distributed storage systems (e.g., HDFS, S3).
• Expertise with ETL schedulers such as Apache Airflow, Luigi, Oozie, AWS Glue or similar frameworks.
• Solid understanding of data warehousing concepts and hands-on experience with relational databases (e.g., PostgreSQL, MySQL) and columnar databases (e.g., Redshift, BigQuery, HBase, ClickHouse).
• Proficient in data serialization formats such as JSON, Avro, Protobuf or Parquet. Knowledge of cloud platforms (e.g., AWS, Azure, GCP) and experience with their data-related services (e.g., S3, EC2, EMR, Dataflow).
• Experience with version control systems (e.g., Git, SVN, Mercurial) and expertise with CI/CD practices.
• Strong problem-solving skills and the ability to troubleshoot complex data issues.
• Excellent communication skills, with the ability to effectively collaborate with cross-functional teams and explain technical concepts to non-technical stakeholders. 

Your Location:

This position is US - Remote Eligible. The role may include occasional work at an Airbnb office or attendance at offsites, as agreed to with your manager. While the position is Remote Eligible, you must live in a state where Airbnb, Inc. has a registered entity. Click here for the up-to-date list of excluded states. This list is continuously evolving, so please check back with us if the state you live in is on the exclusion list. If your position is employed by another Airbnb entity, your recruiter will inform you what states you are eligible to work from.

Our Commitment To Inclusion & Belonging:

Airbnb is committed to working with the broadest talent pool possible. We believe diverse ideas foster innovation and engagement, and allow us to attract creatively-led people, and to develop the best products, services and solutions. All quali