Senior Engineer, Enterprise AI Services

Within Platform Engineering and Enterprise AI Services, the Senior Engineer, Enterprise AI Services is responsible for designing, building, and operating observability capabilities for AI and LLM workloads that power TR's AI-driven products. This role ensures our AI systems—from classical ML to generative AI—are observable, debuggable, reliable, and continuously improving across TR's multi-cloud footprint (AWS, Azure, GCP) and internal Kubernetes platform.

You will own the end-to-end observability stack for AI (with Braintrust as foundational platform), enabling product teams, data scientists, and AI engineers to understand model behavior in production, detect issues early, and make data-driven improvements to model quality, latency, and cost.

The successful candidate will help build the next generation of TR's AI observability and evaluation platform, working alongside cloud engineering, data engineering, Enterprise AI Services, and product teams.

About the Role

In this opportunity as a Senior Engineer – Enterprise AI Services, you will:

• Serve as the Kubernetes expert for AI services, defining and operating deployment standards for scalability, resilience, security, and performance.

• Own the AI observability platform, implementing tools such as Braintrust and Langfuse to support tracing, evaluation, analytics, and monitoring of LLM/ML workloads.

• Define and standardize telemetry across AI products, including traces, metrics, logs, evaluations, and feedback, while ensuring governance, privacy, and auditability requirements are met.

• Build telemetry pipelines, dashboards, and reporting that provide clear visibility into model performance, quality, safety, reliability, and cost.

• Establish monitoring, alerting, SLOs/SLIs, and incident response practices for AI systems, including root cause analysis and continuous improvement.

• Integrate observability and evaluation into CI/CD so new models, prompts, and workflows are automatically enrolled in monitoring and quality controls.

• Partner with Product, Data Science, AI Engineering, SRE, Platform, and Cloud teams to onboard new AI use cases, support experimentation and drift detection, and implement guardrails and policy enforcement.

About You

You’re a fit for the role of Senior Engineer if you have the following required qualifications:

• Strong understanding of LLM/ML fundamentals and production AI systems, including prompting, context windows, RAG, hallucinations, and model/provider variability and capacity.

• Hands-on experience with AI observability and evaluation platforms, with Braintrust and/or Langfuse strongly preferred. Solid background with modern observability tooling, ideally Datadog.

• Deep Kubernetes experience deploying and operating services in production, including Helm-based releases, ingress/service networking, scaling, and troubleshooting.

• Proficiency in Python plus at least one additional backend or platform language such as TypeScript/JavaScript, Go, or Java. C# is an asset.

• Experience with API workloads across AWS, Azure, or GCP, including custom endpoints, and cloud-native production environments.

• 5+ years in SRE, Observability Engineering, ML Platform, or similar roles, including 2+ years supporting production LLM/ML systems, preferably in enterprise or regulated environments.

Additional preferred qualifications include:

• Strong collaboration and communication skills, with the ability to work effectively across Product, Engineering, Data Science, SRE, and Cloud teams.

• Experience working in Agile environments, with familiarity in iterative delivery, sprint planning, backlog refinement, and cross-functional team execution.

• Demonstrated curiosity about AI technologies and a strong willingness to learn, adapt, and stay current with the rapidly evolving LLM/ML landscape.

• Strong problem-solving skills, sound judgment during incidents, and a continuous improvement mindset.

#LI-ES1

What’s in it For You?

• Hybrid Work Model: We’ve adopted a flexible hybrid working environment (2-3 days a week in the office depending on the role) for our office-based roles while delivering a seamless experience that is digitally and physically connected.

• Flexibility & Work-Life Balance: Flex My Way is a set of supportive workplace policies designed to help manage personal and professional responsibilities, whether caring for family, giving back to the community, or finding time to refresh and reset. This builds upon our flexible work arrangements, inc