Senior Data Scientist – LLM Expert

Who We Are

At Kyndryl, we design, build, manage and modernize the mission-critical technology systems that the world depends on every day. So why work at Kyndryl? We are always moving forward – always pushing ourselves to go further in our efforts to build a more equitable, inclusive world for our employees, our customers and our communities.

The Role

We’re looking for exceptional talent to join our AI Agentic Innovation Hub at Kyndryl!

The AI Agentic Innovation Hub stands as Kyndryl’s center of excellence for advanced and agentic artificial intelligence. Our mission is to lead the design and deployment of transformative AI solutions that bridge frontier research with real-world impact — scalable, secure, and driven by measurable value. 
Built upon a team of exceptional talent and cutting-edge technology, the Hub embodies a spirit of bold innovation and disciplined execution — an elite unit within one of the world’s leading technology companies. With national reach and global ambition, we partner with major organizations to tackle their most complex challenges, pioneering the next generation of intelligent, autonomous, and trusted systems that redefine what AI can achieve. 
 

Job Description 

As a Senior Data Scientist specialized in Large Language Models at Kyndryl’s AI Innovation Hub, you’ll help shape the frontier of intelligent and agentic systems — turning cutting-edge research into real-world impact for some of the world’s most forward-thinking enterprises. 
You’ll work with state-of-the-art technologies, foundation models, and emerging agentic frameworks to design, fine-tune, and deploy powerful LLM-based solutions that understand, reason, and generate language with purpose. 
In this role, you’ll collaborate closely with architects, ML engineers, and product teams to transform ideas into production-ready systems that redefine how organizations interact with knowledge and automation. 
You’ll operate in an environment that values experimentation, precision, and creativity — where you’ll be encouraged to explore the limits of generative AI, drive technical excellence, and contribute to solutions used by top global clients. 
If you’re passionate about transforming language models into intelligent agents that can think, act, and assist — this is where your work will make a lasting mark. 

Your Mission 

• Design, train, fine-tune, and evaluate large language models and their distilled or specialized variants (SLMs). 

• Develop and integrate Generative AI and Agentic AI solutions that combine reasoning, retrieval, and language understanding. 

• Implement and optimize RAG (Retrieval-Augmented Generation) pipelines, ensuring precision, traceability, and scalability. 

• Collaborate with architects and ML engineers to bring LLM-based solutions into production environments. 

• Define and apply robust evaluation frameworks and metrics for alignment, safety, hallucination control, and factual consistency. 

• Contribute to the Hub’s innovation roadmap by exploring new models, architectures, and methods for fine-tuning and instruction learning. 

• Advise on model optimization, including quantization, distillation, and memory-efficient inference. 

• Promote best practices in documentation, traceability, and Responsible AI across all LLM-based initiatives. 

Who You Are

Essential Qualifications 

• 4+ years of experience in AI model development, with at least 2 years focused on LLMs or advanced NLP systems. 

• Proven expertise in fine-tuning, inst