Engineer IV (QA)

Engineer IV – Quality  

College Board - Technology 

Location: 1) This is a fully remote role.  

Type:  

• This is a full-time position 

About the Team  

We are a team of technologists working together to solve complex technical problems and develop innovative solutions. Embracing a culture of continuous improvement, we look for ways to incorporate new technologies in the delivery of systems that are responsible for analysis and scoring of tests of SAT/PSAT and AP programs, all with the singular purpose of providing comprehensive assessments to millions of students. We regularly collaborate while pitching and sharing our ideas to help define the future of our applications. Our team is characterized by our positive team culture, strong technical skills, focus on delivering value and our ability to have fun while being productive.  

About the Opportunity   

As an Engineer IV focused on quality, you are responsible for ensuring the quality and reliability of key scoring capabilities of College Board’s assessments through advanced testing strategies, automation frameworks and an advanced knowledge of QA best practices.  Leveraging your AWS expertise, strong analytical and problem-solving skills, you will analyze complex feature requirements, automate testing processes, and drive efficiencies. Collaborating with cross-functional teams, you will contribute to improving reliability and efficiency of systems. This role is ideal for someone who thrives in a fast-paced, Agile environment and is eager to make a meaningful impact on the digital transformation of SAT, PSAT, and AP exams. 

In this role, you will: 

• Design, develop, implement and maintain comprehensive test plans, test cases and automated test suites 

• Collaborate with product managers and developers to review requirements and ensure testability 

• Design and develop automated testing frameworks for scoring products 

• Maintain CI/CD pipelines with integrated automated testing 

• Identify, recommend and implement tools to enhance testing efficiency 

• Conduct functional, regression, performance and security testing 

• Track and analyze test results, defect trends and root causes 

• Ensure compliance with quality and security standards  

• Collaborate with business and technical teams to translate data insights into actionable recommendations. 

• Develop and participate in the review of requirements, data mappings, user stories, and other artifacts, clearly communicating to both business and technical team members. 

• Assist in resolving production issues by troubleshooting and working with engineering teams to implement fixes. 

• Support functional testing by validating data accuracy, system behavior, and process integrity.  

About you, you have 

• Bachelor’s degree in computer science, Computer Engineering, Software Engineering or eq