Test Engineer - AI/LLM

About the job you’re considering

We are seeking a passionate and innovative Software Development Engineer in Test (SDET) to join our Quality Engineering team and lead the development of LLM- and agentic-based testing solutions. This role blends traditional automation expertise with cutting-edge AI technologies to build intelligent, scalable, and autonomous testing frameworks that redefine how we validate software quality.

Your role

• Design and implement end-to-end testing frameworks leveraging Large Language Models (LLMs) and agentic workflows.
• Develop and maintain automated test suites for UI, API, and data layers across multiple platforms.
• Collaborate with AI/ML engineers to integrate Natural Language Processing (NLP) models into testing pipelines.
• Build and manage test data pipelines for diverse applications and environments.
• Create and maintain CI/CD pipelines to support continuous testing and deployment.
• Identify and resolve environmental and data dependencies for comprehensive E2E testing.
• Lead defect triage, backlog grooming, and root cause analysis sessions.
• Train business users and QA teams on utilizing AI-powered testing tools and dashboards.

Your skills and experience

• At least 1 year experience in AI based Testing environments
• Programming Languages: Strong proficiency in Python (preferred), Java, or JavaScript.
• Automation Tools: Experience with Selenium, Playwright, Cypress, or similar frameworks.
• API Testing: Skilled in tools like Postman, RestAssured, or equivalent.
• LLM/NLP Fundamentals: Understanding of transformers, prompt engineering, and model integration.
• Agentic Frameworks: Exposure to LangChain, AutoGPT, or Semantic Kernel.
• Test Data Engineering: Experience with SQL/NoSQL, synthetic data generation, and data masking.
• CI/CD & DevOps: Familiarity with Jenkins, GitHub Actions, or Azure DevOps.
• Cloud & Containers: Hands-on experience with AWS, Azure, or GCP; Docker, Kubernetes.
• Monitoring & Observability: Knowledge of Grafana, ELK Stack, or Prometheus.
• Soft Skills: Excellent communication, collaboration, and problem-solving abilities.
• Bachelor’s or Master’s degree in Computer Science, Engineering, or equivalent experience
• Experience working in Agile/Scrum environments.
• Exposure to AI/ML testing or model validation practices.

Life at Capgemini

Capgemini supports all aspects of your well-being throughout the changing stages of your life and career. For eligible employees, we offer:

• Flexible work
• Healthcare including dental, vision, mental health, and well-being programs
• Financial well-being programs such as 401(k) and Employee Share Ownership Plan
• Paid time off and paid holidays
• Paid parental leave
• Family building benefits like adoption assistance, surrogacy, and cryopreservation
• Social well-being benefits like subsidized back-up child/elder care and tutoring
• Mentoring, coaching and learning programs
• Employee Resource Groups
• Disaster Relief

About Capgemini

Capgemini is a global business and technology transformation partner, helping organizations to accelerate their dual transition to a digital and sustainable world, while creating tangible impact for enterprises and society. It is a responsible and diverse group of 340,000 team members in more than 50 countries. With its strong over 55-year heritage, Capgemini is trusted by its clients to unlock the value of technology to address the entire breadth of their business needs. It delivers end-to-end services and solutions leveraging strengths from strategy and design to
engineering, all fueled by its market leading capabilities in AI, generativ