IT Software Engineer 4 (AI Architect for Testing)
3Core Systems, IncAbout the role
This is a remote position.
Job Title: IT Software Engineer 4 (AI Architect for Testing)
Location: Chicago IL 60661 (Remote)
Duration: 12+ months contract
Job Description:
We’re looking for an AI Architect to lead how our testing organization uses AI to improve quality, speed, coverage, and insight across the software delivery lifecycle. This person will define the AI strategy for QA and testing, design AI-enabled testing solutions, guide tool selection and integration, and help teams adopt AI responsibly in day-to-day testing activities.
Typical task breakdown:
· Define the AI vision and architecture for the testing function.
· Identify testing activities that can be improved with AI, including: test case generation, test data creation, automated test maintenance, defect prediction, root cause analysis, log and failure analysis, requirements-to-test traceability, risk-based test prioritization, intelligent regression selection.
· Design and implement AI-enabled frameworks for: functional testing, API testing, UI automation, performance testing, security testing support, exploratory testing augmentation.
· Partner with QA, developers, DevOps, product managers, and data teams to embed AI into CI/CD and quality engineering workflows.
· Evaluate and recommend AI/ML, GenAI, and test automation tools.
· Establish standards for AI governance, privacy, security, explainability, and responsible usage in testing.
· Create architecture for integrating LLMs, test repositories, defect systems, observability tools, and CI platforms.
· Define metrics to measure the effectiveness of AI in testing, such as: defect leakage, automation coverage, test execution efficiency, flaky test reduction mean time to diagnose failures, release quality trends.
· Mentor QA engineers and SDETs on AI-assisted testing practices.
· Lead pilots, proofs of concept, and scaled rollout of AI testing capabilities.
· Ensure compliance with enterprise policies for data handling and model usage.
Interaction with team :
· Working with team; team consists of 20+ folks
Education & Experience Required:
· Years of experience: 8-10 yrs experience.
· Degree requirement: Bachelor’s degree and 8+ years of experience.
Required Technical Skills:
· 8+ years in software testing, QA automation, quality engineering, or test architecture.
· 3+ years designing or implementing AI/ML or GenAI-based solutions in enterprise environments .
· Strong understanding of: software testing methodologies, test automation frameworks
· SDLC/STLC
· CI/CD pipelines
· Quality Engineering Practices
· Experience with AI technologies such as: Machine Learning models, NLP, LLMs, Prompt Engineering, retrieval-augmented generation concepts
· AI agents/workflow automation
· Hands-on experience with tools/languages such as Python, Java, JavaScript, SQL, and test tools like Selenium, Playwright, Cypress, Appium, JUnit, TestNG, PyTest, or simil
Apply for this role
Generate a tailored application kit with a matched cover letter, interview prep, and CV highlights — in under 60 seconds.
Apply Now →Generate Application KitFree account required — sign up in 30s