Jobs and Careers
SA

Senior Engineering Manager - Machine Learning

SAP
Palo Alto, United Statesfull_timeVerifiedPosted 3 Nov 2025
💰 $609,200/yr($274,300/yr$609,200/yr)

About the role

We help the world run better
At SAP, we keep it simple: you bring your best to us, and we'll bring out the best in you. We're builders touching over 20 industries and 80% of global commerce, and we need your unique talents to help shape what's next. The work is challenging – but it matters. You'll find a place where you can be yourself, prioritize your wellbeing, and truly belong. What's in it for you? Constant learning, skill growth, great benefits, and a team that wants you to grow and succeed. 

 

 

We are looking for an experienced and visionary Senior Engineering Manager - Machine Learning to lead a high-performing team building distributed systems that power AI and large language model (LLM) capabilities at scale. In this role, you will define technical direction, foster innovation, and ensure your team delivers impactful, production-grade systems that shape the future of SAP’s AI offerings

 

Description 
As the leader of a fast-moving and collaborative team, you will guide the design, development, and deployment of cutting-edge AI infrastructure. You’ll be responsible for growing and mentoring engineering talent, setting technical priorities, and working closely with cross-functional partners to align on vision and execution. We’re seeking someone who thrives in ambiguous environments, can connect high-level strategy to concrete deliverables, and inspires engineers to achieve their best work.

 

Key Responsibilities

  • Lead and inspire a team of engineers delivering backend systems, APIs, databases, and LLM infrastructure
  • Define and communicate technical vision, ensuring alignment with product and business goals
  • Collaborate with product managers, researchers, and architects to translate ideas into scalable solutions
  • Foster a culture of technical excellence, innovation, and continuous improvement
  • Provide hands-on technical guidance where needed, ensuring high-quality code and architecture
  • Oversee projects leveraging modern distributed systems, data platforms, and API frameworks
  • Build team capabilities through mentoring, recruitment, and career development initiatives

 

Minimum Qualifications

  • Bachelor’s degree in Computer Science, Mathematics, Physics, or related field; advanced degree preferred
  • 10+ years of software engineering experience, with at least 5 years in an engineering leadership role
  • Proven track record of delivering complex, distributed systems in production
  • Strong understanding of AI/ML and/or LLM systems and their application in real-world products
  • Experience managing teams in fast-paced, high-growth environments
  • Strong decision-making skills and ability to balance technical depth with business priorities
  • Excellent English communication skills and ability to lead in global, multicultural environments

 

Preferred Qualifications

  • Experience scaling engineering teams and processes in enterprise environments
  • Open-source contributions or engagement in the AI/ML community
  • Familiarity with modern development practices, CI/CD, and cloud-native architectures

 

Why Join Us

  • Lead a team building cutting-edge AI systems with global impact High-trust, high-autonomy culture with minimal bureaucracy
  • Collaborate with senior engineers and AI experts in a mission-driven environment
  • Play a central role in defining SAP’s AI strategy and delivering transformative capabilities 

 

#SAPAICareers #SAPAIAPP #ICC25

 

Bring out your best
SAP innovations help more than four hundred thousand customers worldwide work together more efficiently and use business insight more effectively. Originally known for leadership in enterprise resource planning (ERP) software, SAP has evolved to become a market leader in end-to-end business application software and related services for database, analytics, intelligent technologies, and experience management. As a cloud company with two hundred million users and more than one hundred thousand employees worldwide, we are purpose-driven and future-focused, with a highly collaborative team ethic and commitment to personal development. Whether connecting global industries, people, or p

Apply for this role

Generate a tailored application kit with a matched cover letter, interview prep, and CV highlights — in under 60 seconds.

Apply Now →Generate Application Kit

Free account required — sign up in 30s

Company

SAP

View company profile →