Sr. Testing Engineer

AI Testing Engineer 

Position Overview 

Skilled AI Testing Engineer to design, execute, and automate tests for AI/ML models, data pipelines, and intelligent applications. This role will focus on ensuring quality, reliability, and fairness across AI systems by validating data inputs, model outputs, and overall system performance. The ideal candidate combines strong QA engineering skills with exposure to AI/ML workflows and tools. 

Key Responsibilities 

• Develop and execute test plans and scripts for AI/ML models and data pipelines. 

• Validate training datasets for completeness, quality, and accuracy. 

• Test AI/ML outputs for precision, recall, bias, drift, and explainability. 

• Build automation scripts for continuous validation within MLOps pipelines. 

• Collaborate with data scientists and MLOps engineers to define acceptance criteria for AI systems. 

• Perform functional, integration, regression, and performance testing on AI-driven applications. 

• Log defects, track issues, and support remediation with development and data teams. 

• Contributes to the creation of AI quality dashboards and reporting. 

 

Required Qualifications 

• Bachelor’s degree in Computer Science, Engineering, Data Science, or related field. 

• 3–5 years of experience in software testing/QA, with exposure to AI/ML projects. 

• Proficiency in test automation frameworks (PyTest, Selenium, Robot, or similar). 

• Experience with Python or Java for test scripting and data validation. 

• Familiarity with ML frameworks (TensorFlow, PyTorch, Scikit-learn). 

• Basic knowledge of CI/CD and MLOps tools (MLflow, Jenkins, Kubeflow, Databricks). 

• Understanding of data quality principles and validation techniques. 

 

Preferred Skills 

• Exposure to Generative AI / LLM testing (prompt consistency, hallucination detection). 

• Familiarity with AI fairness and explainability tools (SHAP, LIME, AIF360). 

• Knowledge of cloud platforms (AWS, Azure, GCP) and containerized environments (Docker, Kubernetes). 

• Strong problem-solving skills and ability to work in agile, cross-functional teams.