Senior Research Scientist, Validity Research & Services Team

Senior Research Scientist, Validity Research & Services (VRS)   

College Board – Learning & Assessment (L&A) - Research Department  

Location: This is a fully remote role. Candidates who live near CB offices have the option of being fully remote or hybrid (Tuesday and Wednesday in office). 

Type: This is a full-time position 

About the Team  

The Validity Research & Services (VRS) Team is a part of the Research department, housed within the larger Learning & Assessment division. We are responsible for much of the SAT Suite validity research, developing and utilizing a longitudinal database of college outcomes for rigorous test validity and college readiness and success research, and assisting educational institutions in conducting their own validity research on College Board assessments. 

About the Opportunity   

The Senior Research Scientist will lead and contribute to the design and implementation of research studies to support the use of College Board assessments in K-12 and Higher Education institutions, as well as advance our understanding of college and career readiness and success. This individual will have a high level of expertise in research methodology, educational measurement, statistical analysis, and report writing translating complex concepts into clear language for various stakeholders.   This role is responsible for leading the core analytical work behind the digital SAT validity argument, which  includes the first national digital SAT validity study,  foundational research that will be cited across the field for the next decade.  This is a career-defining opportunity for a measurement researcher passionate about high-impact validity work. 

In this role, you will:  

Design & Conduct Research Studies (70%): 

• Lead the initiation, design, development, and completion of high-quality research studies and projects that enhance College Board’s validity research and college and career readiness agenda.   
• Lead the definition of projects of decisive importance to accomplish broader organizational goals.  
• Author and contribute to publications including College Board Research Reports, Statistical Reports, Technical Memos/Manuals/Reports, peer reviewed journal articles, and other important documents.   
• Develop the datasets for projects and the associated quality control (QC) of the dataset when developed by others.  
• Determine the most effective methodologies to employ for studies and carry out rigorous analyses and interpretation of results.  
• Remain up-to-date on advances in educational measurement, the college and career readiness and success literature, and validity research methods and approaches. 
• Mentor junior staff members by reviewing analyses, providing methodological guidance, collaborating on impactful research ideas, and supporting high-quality research outputs. 
• Serve as the primary analyst for many of the Digital SAT validity studies, including core placement, retention, completion, STEM outcomes, subgroup analyses, and institutional patterns. 
• Conduct updated analysis and review of SAT Suite College & Career Readiness Benchmarks. 

Provide Research Consultation to Internal & External Colleagues (30%): 

• Contribute to research-informed requests and response(s) to College Board Communications, College Board Senior Leadership, RFPs, external inquiries from researchers, and College Board Programs – e.g., SAT, AP, etc. 
• Synthesize research findings into clear information and deliverables for various stakeholders. 
• When needed, support presentations translating complex concepts into clear language for the organization and public more broadly. 
• Provide measurement research consultation to College Board programs to inform assessment operations and practices.  
• Collaborate with educational institutions to conduct institution-specific validity studies and consult on related studies as needed. 

About you, you have:  

• Demonstrated ability to lead, design and conduct high quality educational research studies and statistical analyses; including a track record of published work 
• Strong knowledge of educational measurement and psychometrics; well-versed in test validity; knowledgeable about college outcomes as well as career/workforce outcomes  
• Excellent data coding, manipulation, and analysis skills; hands-on coding expertise in Python, R or SAS with a track record of producing analyses, rather than relying on others to execute core statistical work. 
• Broad and deep methodological toolbox, including experience with multilevel modeling, experimental, and quasi-experimental methodologies, meta-analysis, and validity resea