Jobs and Careers
MI

Principal Product Manager - Foundry Inferencing & Training (CoreAI - multiple roles)

Microsoft
New York City, United Statesfull_timeVerifiedPosted 15 Apr 2026
💰 $331,200/yr($139,900/yr$331,200/yr)

About the role

Overview

Microsoft Foundry sits at the center of Microsoft’s AI strategy, powering how models are trained, evaluated, launched, and operated at global scale. Within CoreAI, the AI Models & Training organization is responsible for the platforms, infrastructure, and execution systems that turn cutting‑edge research into reliable, production‑ready AI capabilities.

We are looking for several Principal Product Managers to define our model ecosystem and offerings, to design product shape for inferencing and training. These roles operate at the intersection of model training, inference, experimentation, infrastructure, and developer platforms, and partner closely with engineering, research, data science, and leadership to deliver impact at scale. 

These are highly crossfunctional roles, best suited for product leaders who thrive in ambiguity, bring strong technical fluency, and can translate complex systems into clear strategy, priorities, and outcomes. 



Responsibilities

Product Strategy & Ownership 

  • Own product strategy and roadmap across AI model training, inference, experimentation, and platform enablement, balancing near‑term delivery with long‑term scale 

  • Maintain end‑to‑end accountability from concept through launch, iteration, and measurable impact 

Model Lifecycle & Platform Enablement 

  • Drive initiatives across the AI model lifecycle, partnering with engineering and research to bring new capabilities from research into production 

  • Enable internal teams and customers to access, integrate, and adopt models through high‑quality platform experiences 

Execution, Velocity & Operating Rigor 

  • Lead complex, multi‑quarter initiatives with high visibility, managing dependencies, risks, and tradeoffs across teams 

  • Improve execution velocity by reducing friction in planning, experimentation, launches, and iteration cycles 

Experimentation, Metrics & Continuous Improvement 

  • Define and track metrics for efficiency, performance, reliability, and adoption, using experimentation and data to drive decisions 

  • Identify opportunities for automation, simplification, and continuous improvement as systems scale 

Cross‑Functional Leadership & Communication 

  • Act as a connective leader across engineering, data science, research, infrastructure, and go‑to‑market teams 

  • Influence senior stakeholders through clear decision framing, executive‑ready narratives, and data‑backed recommendations 



Qualifications

Required Qualifications 

  • Bachelor’s Degree and 8+ years of experience in product management, technical program management, software engineering, or related technical fields (or equivalent experience) 

Other Requirements 

  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: 

  • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter. 

Preferred Qualifications 

  • Proven ability to lead product strategy and execution in highly technical, ambiguous, cross‑functional environments 

  • Strong technical fluency and ability to partner deeply with engineering, infrastructure, or research teams 

  • Excellent written and verbal communication skills, including executive‑level influence 

  • 10+ years of experience delivering large‑scale platforms, cloud services, or AI‑powered products 

  • Experience with AI/ML platforms, model training systems, inference infrastructure, or experimentation frame

Apply for this role

Generate a tailored application kit with a matched cover letter, interview prep, and CV highlights — in under 60 seconds.

Apply Now →Generate Application Kit

Free account required — sign up in 30s

Company

Microsoft

View company profile →