Sr. Engineering Manager, Inference

What You’ll Do:

As a Senior Engineering Manager for the AI/ML Platform team, you will lead the group responsible for productizing and operating our inference offering. In partnership with CoreWeave AI platform team, you will ensure the service becomes a polished, reliable, developer-friendly product within the AI/ML Platform.

You will guide engineers working on areas such as service reliability, observability, operational excellence, packaging, developer-facing tooling, and application-layer enhancements. You will partner closely with Product, CoreWeave engineering teams, Design, Support, and GTM stakeholders to ensure the inference experience meets the needs of practitioners deploying and scaling real-world AI workloads. Your work will directly support end-users, as well as other products powered by this service, like W&B Training.

You will combine strong engineering leadership with clarity in execution, helping the team deliver improvements that raise reliability, accelerate development workflows, and strengthen the overall inference experience for W&B users.

Responsibilities

• Lead and grow the engineering team responsible for evolving and operating the W&B Inference product, focusing on service reliability, orchestration, operational maturity, and developer experience.
  
  
• Drive execution on roadmap initiatives in close partnership with Product, ensuring that platform capabilities are delivered predictably, robustly, and with measurable customer impact.
  
  
• Own the engineering processes for the inference productization layer, including incident response, operational readiness, release management, observability, and engineering quality.
  
  
• Partner with CoreWeave’s infrastructure teams to integrate capabilities from the underlying inference platform into a cohesive, user-facing product.
  
  
• Guide the design and delivery of application-layer enhancements such as tracing and tool call handling.
  
  
• Ensure the inference offering meets high standards of reliability, usability, compliance, and performance, balancing trade-offs across cost, operational load, and architectural constraints.
  
  
• Create clarity in complex, cross-functional environments, ensuring strong communication, aligned priorities, and smooth execution across multiple teams.
• Build a culture of ownership, technical excellence, and continuous improvement within the engineering team.

Who You Are: 

• 7+ years of experience in software engineering, including 3+ years managing or leading engineering teams responsible for distributed systems, developer platforms, or large-scale services.
• Fluent in concepts related to distributed compute services, including observability, autoscaling patterns, reliability engineering, API design, and service operations.
• Comfortable with competing priorities and making principled trade-offs among latency, reliability, cost, and development velocity.
• Skilled at leading engineering teams through ambiguous, multi-stakeholder projects with strong communication and alignment.
• Deep empathy for ML practitioners and platform developers, with a drive to improve reliability, reduce friction, and elevate the developer experience.

Preferred

• Background in high-scale systems, real-time APIs, or cloud infrastructure, ideally with exposure to model-serving or inference-adjacent domains.
  
  
• Background in related platform domains such as IAM, billing/metering, observability systems, or deployment tooling.
  
  

Wondering if you’re a good fit? We believe in investing in our people,