Senior QA Automation Engineer
College BoardAbout the role
Senior QA Automation Engineer
College Board – Technology – AI Services Infrastructure
Location: This is a fully remote role. Candidates who live near CB offices have the option of being fully remote or hybrid (Tuesday and Wednesday in office).
Type: This is a full-time position
About the Team
We're a small, close-knit team enabling AI services for specific departments within College Board, working at the intersection of Product, Engineering, and Psychometrics. You'll help build and evolve software that supports College Board's large-scale assessment programs, ensuring accurate, reliable outcomes for the students and educators who rely on them. We're currently building and evolving this capability internally, with a focus on improving efficiency, reliability, and the day-to-day experience of the students and large educator workforce involved in this process. Being small means everyone has real influence: you'll wear multiple hats, partner closely with Product and Psychometrics, and help shape a broader ecosystem of scoring and orchestration services as it takes shape.
About the Opportunity
As a Senior QA Automation Engineer, you will be helping to develop and validate critical components that will enhance learning opportunities and feedback for millions of students, while also contributing to the needs of educators. For this team, you will be the primary quality-focused engineer, ensuring that solutions coming out of the team are well-crafted and meet the needs of all stakeholders from both a functional and technical standpoint. You will also be asked to help explore new technologies, identify opportunities that benefit Technology as a whole, and participate in AI-driven SDLC processes.
In this role, you will:
Design & Implementation (60%)
Design and implement testing strategies, including agentic AI, to provide automated validation of quality metrics and gates within the system. Identify appropriate testing strategies to apply for differing scenarios and processes. Provide expert guidance on functional and data-oriented risks.
Help ensure that system components are built with security as a high priority.
Maintain the highest engineering standards in collaboration with product owners, architects, and stakeholders, in support of our systems and services
Understand new product capabilities and decompose the implementation into specific functional changes for verification
Create appropriate mock services to ensure zero dependency, where possible, with other teams
Apply for this role
Generate a tailored application kit with a matched cover letter, interview prep, and CV highlights — in under 60 seconds.
Apply Now →Generate Application KitFree account required — sign up in 30s