Senior Manager, AI Reliability Engineering -Kroger Technology & Digital (P2498)
84.51°About the role
84.51° Overview:
84.51° is a retail data science, insights and media company. We help The Kroger Co., consumer packaged goods companies, agencies, publishers and affiliates create more personalized and valuable experiences for shoppers across the path to purchase.
Powered by cutting-edge science, we utilize first-party retail data from more than 62 million U.S. households sourced through the Kroger Plus loyalty card program to fuel a more customer-centric journey using 84.51° Insights, 84.51° Loyalty Marketing and our retail media advertising solution, Kroger Precision Marketing.
84.51° follows a 5‑day in‑office work schedule to support collaboration, alignment, and team connection.
Join us at 84.51°!
__________________________________________________________
PLEASE NOTE: This role is on the Kroger Technology & Digital (KTD) team. KTD is the technology division of The Kroger Co. responsible for building, operating, and innovating the digital infrastructure and software that powers Kroger’s retail stores, e-commerce platforms, supply chain, and corporate operations. There is a strong collaboration between KTD and 84.51°.
Role Summary
The Senior Manager, AI Reliability Engineering at KTD leads the engineering discipline that makes enterprise AI operationally trustworthy at scale. As the enterprise moves from AI pilots to production systems that associates and customers depend on every day, this leader ensures that models, agents, copilots, AI gateways and shared runtime services are dependable, high-quality, responsive and cost-efficient by design. This leader will stand up a new discipline from the ground up: defining what production-grade AI means, engineering the standards and automation that bake reliability and quality into every system, and shaping how build teams design for resilience from day one. The role blends engineering leadership, technical ownership and cross-functional influence. Reliability is a strategic enabler of adoption and velocity - the difference between experimenting with AI and confidently running it at scale.
Key Responsibilities
*Build the Discipline (0-to-1)
*Define what production-grade, operationally trustworthy AI means for the enterprise, including standards and quality bars for availability, behavior, latency, cost, control and recovery.
*Stand up the AI Reliability Engineering function, its charter, operating model, roadmap, talent model and engineering culture.
*Position reliability as an enabler of AI adoption and velocity, creating the confidence that allows the business to scale AI responsibly and aggressively.
*Engineer Reliability and Quality Into Systems
*Partner with Platform, Model and Applied AI teams to embed resilience, testability, observability and safe failure modes into AI systems from architecture forward.
*Build reliability tooling and automation, including self-healing, automated evaluations, quality-regression detection, guardrail instrumentation and safe deployment controls.
*Establish service-level indicators, service-level objectives, error budgets and reliability scorecards that shape architecture, delivery and roadmap decisions.
*Engineer for high availability, graceful degradation, capacity, disaster recovery and rapid restoration while reducing manual toil and systemic failure patterns.
*Provide Production Readiness and Agent Onboarding
*Create production-readiness standards covering named business and engineering owners, support models, runbooks, telemetry, quality evaluations, security and Responsible AI controls, escalation paths, service objectives and lifecycle controls.
*Lead launch-readiness reviews for new platforms, models and agents, and make evidence-based readiness decisions with clear exception and risk-acceptance paths.
*Build a scalable onboarding model for both centrally developed agents and domain-owned agents operating on shared enterprise platforms.
*Own Production Quality, Observability and AgentOps
*Own live observability, production-quality signals and leadership visibility across model and agent behavior, drift, hallucination and quality rates, latency, tool failures and evaluations in production.
*Partner with Responsible AI to translate offline evaluation, risk and safety standards into continuous, automated production signals and operational controls.
*Own the operational capabilities of the Agent Control Center, including estate health, pause, isolation, rollback, shutdown and lifecycle controls for unsupported or persistently unreliable agents.
*Drive Efficiency and Performance
*Engineer for cost and performance at scale, optimizing inference cost, token efficiency, model and ro
Apply for this role
Generate a tailored application kit with a matched cover letter, interview prep, and CV highlights — in under 60 seconds.
Apply Now →Generate Application KitFree account required — sign up in 30s