Staff AI Operations Engineer / Builder

Yahoo Mail is the ultimate consumer inbox with hundreds of millions of users. It’s the best way to access your email and stay organized from a computer, phone or tablet. With its beautiful design and lightning fast speed, Yahoo Mail makes reading, organizing, and sending emails easier than ever.

A Little About Us

Yahoo, with 900M+ monthly users, is in the midst of a renaissance, backed by meaningful investment to drive long-term growth through great products. Yahoo Mail is one of the world’s largest consumer email platforms, serving 200M+ monthly users across web and mobile. We are now entering the next chapter: transforming Yahoo Mail from a traditional product and operating organization into an AI-native one. This means changing not only what we build for users, but how the organization itself works, decides, learns, and executes.

About the Role

We are hiring a Staff AI Operations Builder (IC5) to architect the AI-native operating engine for Yahoo Mail. This is a high-agency, strategic builder role for an advanced professional who can turn messy organizational workflows into scalable, working platforms: agents, sub-agents, internal tools, operating dashboards, knowledge engines, and workflow automations that scale the productivity of the entire business.

This role sits close to Strategy, BizOps, and Analytics, working horizontally across Product, Engineering, Design, Revenue, and Executive Leadership to define the architectural roadmap and establish the baseline systems of proactive operational intelligence.

Responsibilities

• Architect and deploy full-stack internal AI products, from secure backend LLM integrations and agentic workflow orchestration to responsive frontend operating interfaces.

• Define the foundational engineering patterns, guardrails, and platform architectures for reliability, data permissions, enterprise privacy, and observability across all internal AI systems.

• Establish automated LLM evaluation (Evals), output validation frameworks, and human-in-the-loop validation flows to proactively mitigate inaccuracies or hallucinations in operational systems.

• Incorporate state-of-the-art developer frameworks—including AWS Bedrock, Vertex AI, and advanced orchestration patterns—to abstract operational workflows into reusable API layers.

• Design, deploy, and continuously optimize multi-agent orchestrations and retrieval-augmented generation (RAG) pipelines that ingest contextual product metadata to synthesize real-time business context.

• Collaborate horizontally with Product, Engineering, Design, and Executive leadership to map physical organizational processes into autonomous workflows, serving as the technical authority on internal AI capabilities.

• Mentor and uplevel adjacent engineering, product, and operational squads on prompt engineering, structured LLM interactions, and automated workflow adoption.

• Turn highly ambiguous, fragmented data sources (e.g., Jira trackers, Google Workspace documents, analytics dashboards) into structured, queryable knowledge networks.

Basic Qualifications

• 8+ years of software engineering, product management, technical systems-building, or platform architecture experience with a focus on full-stack application development.

• Professional experience designing, implementing, and evaluating LLM-backed applications, multi-agent frameworks, RAG architectures, or automated internal operations systems.

• Deep familiarity with production-grade AI development platforms (e.g., AWS Bedrock, Vertex AI) and modern coding assistants (e.g., Cursor, Claude Code) to accelerate software delivery cycles.

• Demonstrated experience building custom API integrations with enterprise platforms (such as Jira, Confluence, and Google Workspace) to automate manual processes.

• High-agency ownership with a proven track record of delivering architectural strategy and shipping complex, operational platforms in highly ambiguous environments.

• Strong proficiency in modern software engineering stacks, including Python, TypeScript, React, Node.js, and relational/non-relational data systems.

• Excellent written and verbal communication skills, with experience presenting complex technical architectures directly to senior stakeholders.

Preferred Qualifications

• Experience deploying and tuning open-source agentic frameworks or managing large-scale internal copilot environments.

• Experience in Product Operations, Business Operations, Strategy, or Technical Program Management