Senior ML Scientist - Generative AI

We help the world run better
At SAP, we keep it simple: you bring your best to us, and we'll bring out the best in you. We're builders touching over 20 industries and 80% of global commerce, and we need your unique talents to help shape what's next. The work is challenging – but it matters. You'll find a place where you can be yourself, prioritize your wellbeing, and truly belong. What's in it for you? Constant learning, skill growth, great benefits, and a team that wants you to grow and succeed. 

 

Summary:

At SAP, we integrate AI technology with extensive industry-specific data and deep process knowledge to create innovative AI capabilities for all SAP applications. Large Language Models (LLMs) hold immense potential to change the way we work and develop products. They are reshaping the landscape of Machine Learning across various domains.

SAP AI Product Engineering is responsible for designing central frameworks and cloud services such as Joule, Generative AI Hub, AI Core, and Document Information Extraction as the AI foundation for embedded AI throughout our portfolio in addition to our efforts towards SAP’s foundation models, both our own tabular business models and building on top of partner LLMs, and generative AI technologies.

 

The Role:

· Play a key role in building enterprise AI solutions, embedded within SAP’s rich and diverse business data context.

· Solve complex problems using cutting-edge LLMs focusing on in-context learning, fine-tuning or pre-train models.

· Apply expertise in data pre-processing, Information Retrieval, Retrieval-Augmented Generation (RAG), and Agentic AI to improve multimodal question answering.

· Stay on top of the latest advancements in LLMs, Foundation Models, and Machine Learning; leverage this knowledge to enhance models and drive product quality.

· Define ML tasks, develop and implement models or hypotheses, and present experiments and results effectively that address real-world enterprise challenges.

· Collaborate cross-functionally with other teams to align AI capabilities and models with SAP’s strategic objectives and product roadmap.

· Establish and lead research collaborations with academic and commercial partners.

· Contribute towards thought leadership and innovation in new data modalities for Foundation Models and Generative AI

 

What you bring:

· PhD or master’s degree in computer science, Artificial Intelligence, or a related field.

· 5+ years of relevant experience in Machine Learning, including at least 1 year working with LLMs.

· Extensive hands-on experience with LLMs, fine-tuning, or deep learning.

· Strong understanding of the challenges and opportunities in applying Generative AI within a business context.

· Proficiency in Python, with practical experience using ML frameworks such as PyTorch, TensorFlow, or similar.

· Experience with agentic AI frameworks (e.g., LangGraph or equivalent).

· An established record of publications related to LLMs, Foundation Models, or Knowledge Graphs.

· Proven ability to apply AI systems effectively and a strong motivation to continuously grow technical skills in fine-tuning and scalable ML solutions.

· Nice to have some Knowledge Graph exposure. (GraphRAG, Graph ML like Graph Neural Networks etc)

 

Meet your team:

SAP's AI organization is dedicated to seamlessly infusing AI into all enterprise applications, enabling customers, partners, and developers to enhance business processes and generate remarkable business value. Join our international AI team where innovation thrives, opportunities for personal development abound, and exceptional colleagues collaborate globally

Bring out your best
SAP innovations help more than four hundred thousand customers worldwide work together more efficiently and use business insight more effectively. Originally known for leadership in enterprise resource planning (ERP) software, SAP has evolved to become a market leader in end-to-end business application software and related services for database, analytics, intelligent technologies, and experience management. As a cloud company with two hundred million users and more than one hundred thousand employees worldwide, we are purpose-driven and future-focused, with a highly collaborative team ethic and commitment to personal development. Whether connecting global industries, people, or platforms, we help ensure every challenge gets the solution it deserves. At SAP, you can bring out your best.  

We win with inclusion
SAP’s culture of inclusion, focus on health and well-being, and flexible working models help ensure that everyone – regardless of background – feels included and can run at their best. At SAP, we believe we are