Job Details:

Job Description: 

The AI Compute Software Product Manager owns the product strategy, roadmap, and execution for performance‑critical middleware layers enabling AI training and inference on modern accelerators and CPUs. This role sits at the intersection of hardware capabilities, frameworks, and system‑level software, ensuring scalable, high‑performance, and developer‑friendly compute plumbing across AI workloads.

The PM will work in a matrixed organization, collaborating horizontally with stack‑layer owners and vertically with product managers to deliver Day‑0 readiness, sustained performance leadership, and ecosystem adoption.

Key Responsibilities

• Define and own the product vision and roadmap for AI compute middleware

• Translate hardware capabilities into middleware features that unlock performance and usability

• Drive performance, scalability, and correctness requirements across AI training and inference workloads

• Partner closely with Framework PMs (PyTorch, JAX, vLLM, etc.), Driver and firmware teams, Compiler and kernel engineers

• Prioritize investments based on Model and workload trends, Customer requirements, Competitive analysis and benchmarks

• Ensure Day‑0 enablement for new hardware, models, and software releases

• Align backlog and milestones across multiple product lines in a matrixed operating model

• Represent middleware strategy in internal reviews and external technical engagements as needed

• Ability to reason about hardware–software co‑design tradeoffs

• Proven experience working in complex, matrixed organizations

• Strong technical communication and decision‑making skills

Success Metrics

The role is successful when:

• AI workloads achieve measurable performance, efficiency, and scaling gains

• Middleware is adopted broadly by frameworks and solution teams

• Product releases are Day‑0 ready with minimal gaps and escalations

• Developers experience a stable, predictable, and performant compute layer

• Investments result in clear competitive differentiation or cost/TCO improvements

Qualifications:

Minimum Qualifications

• Bachelor's degree with 6 years of experience, or Master's degree in Computer Science, Software Engineering, MBA, or related field with 4 years of experience.

• 6+ years of software product management experience AND 2+ years of background in systems engineering or performance critical software development

Experience in the following:

• AI training and inference workloads

• Compute kernels, math libraries, and runtime performance tuning

• Accelerator architectures (GPU/AI accelerators) and CPUs

Preferred Qualifications

Hands‑on experience with:

• OneDNN, SYCL, Triton, CUDA‑like or kernel‑level programming models

• Experience with AI frameworks or compiler stacks

• Experience with benchmarking, profiling, and performance analysis tools

          

Job Type:

Experienced Hire

Shift:

Shift 1 (United States of America)

Primary Location: 

US, California, Santa Clara

Additional Locations:

US, Arizona, Phoenix, US, Oregon, Hillsboro, US, Texas, Austin

Business group:

At the Data Center Group (DCG), we're committed to delivering exceptional products and delighting our customers. We offer both broad-market Xeon-based solutions and custom x86-based products, ensuring tailored innovation for diverse needs across general-purpose compute, web services, HPC, and AI-accelerated systems. Our charter encompasses defining business strategy and roadmaps, product management, developing ecosystems and business opportunities, delivering strong financial performance, and reinvigorating x86 leadership. Join us as we transform the data center segment through workload driven leadership products and close collaboration with our partners.

Posting Statement:

All qualified applicants will receive consideration for employment without regard to race, color, religion, religious creed, sex, national origin, ancestry, age, physical or mental disability, medical condition, genetic information, military and veteran status, marital status, pregnancy, gender, gender expression, gender identity, sexual orientation, or any other characteristic protected by local law, regulation, or ordina