Senior Data Engineer, User Data Platform

Yahoo serves as a trusted guide for hundreds of millions of people globally, helping them achieve their goals online through our portfolio of iconic products. For advertisers, Yahoo Advertising offers omnichannel solutions and powerful data to engage with our brands and deliver results.

It takes powerful technology to connect our brands and partners with an audience of nearly 900 million. Whether you're designing groundbreaking architecture for mobile apps, leading the evolution of our massive ad tech stacks, or pioneering algorithms to process trillions of data points a day, what you do here will have a transformative impact on our business—and the world. Want in?

A Little About Us:
The Yahoo! Consumer Data Team is developing a unified, cloud-native platform for all Yahoo user data. We simplify how teams access and utilize Yahoo first-party and third-party data while strengthening compliance. Our work empowers business units to enhance experimentation, monetization, marketing, and personalization with greater efficiency and reduced risk.

A Little About You:
The ideal candidate will have a proven track record in engineering roles, particularly in large organizations, with a strong ability to handle complex data challenges. They should be passionate about leveraging data to drive business outcomes and possess excellent collaboration skills to work effectively across teams.
As part of our Audience Platform, you'll play a key role in helping Yahoo leverage first-party and third-party data to build comprehensive audience solutions essential for experimentation, monetization, marketing, and personalization. This large-scale initiative offers you the chance to tackle significant technical challenges while making impactful contributions to how we responsibly utilize data assets across our ecosystem.

Responsibilities:

• Technical Leadership: Lead development of new features and critical enhancements while providing technical direction for team projects
• Solution Architecture: Design scalable frameworks and reusable components that drive platform efficiency and innovation
• Data Pipeline Optimization: Architect and refine ETL pipelines that process terabytes of user data with high reliability
• Quality Assurance: Establish robust validation frameworks and automated testing strategies for data accuracy
• Performance Engineering: Implement optimizations that significantly improve system latency and throughput
• Cross-team Collaboration: Work with product managers to translate business requirements into technical solutions and roadmap priorities
• Production Excellence: Lead incident response for critical production issues and implement systemic improvements to prevent recurrences
• Technical Communication: Effectively articulate complex technical designs to both engineering teams and business stakeholders
• Mentorship: Guide the professional growth of junior and mid-level engineers through code reviews and technical coaching
• Best Practices: Champion engineering excellence through documentation, knowledge sharing, and process improvements

Requirements:

• 5+ years of software engineering experience, with focus on system development and backend services
• 2+ years of experience developing analytics or data processing systems for business applications
• 1+ years experience with Google Cloud Platform components (BigQuery, Dataproc) or AWS equivalent
• 1+ years working with big data technologies (Hadoop, Spark, Hive)
• Experience implementing data pipelines that process datasets at scale
• Strong fundamentals: algorithms, data structures, databases
• Proficiency in at least one programming language from Java, Python, or Scala, with the ability to architect and develop robust applications. SQL knowledge required for database operations
• Knowledge of data enrichment, transformation, and validation processes

The material job duties and responsibilities of this role include those listed above, as well as adhering to Yahoo policies, exercising sound judgment, working effectively, safely, and inclusively with others, exhibiting trustworthiness, and meeting expectations. Additionally, it involves safeguarding business operations and brand integrity.

At Yahoo, we offer flexible hybrid work options that our employees love! While most roles don’t require regular office attendance, you may occasionally be asked to attend in-person events or team sessions. You’ll always get notice to make arrangements. Your recruiter will let you know if a specific job requires regular attendance at a Yahoo office or facility. If you have any questions about how this applies to the role, don't hesitate to ask the recruiter!