Psychometrics Doctoral Internship (Summer 2024)

About the Team 

The Psychometrics Team supports College Board in serving more than seven million students a year as they prepare for a successful transition to college through programs and services in college readiness and college success. The team provides its internal partners with measurement solutions that set the standard for quality, efficiency, and innovation through operational excellence and research leadership that advances the field of Psychometrics and supports College Board' 's mission of access and equity in Education. 

About the Opportunity 

The Psychometrics Department is looking for two doctoral summer interns to join the College Board's Psychometrics Internship Program. This will give interns an exciting chance to develop new skills while contributing to an organization committed to transforming Education in America through college readiness for all students. The Intern will engage in a unique opportunity to develop strengths in core skills and obtain real-world work experience. Throughout this internship experience, you will receive mentorship from experienced Psychometricians and contribute to key projects, collaborating with partners across the organization.  

Interns will work with two College Board mentors on specific projects, including, but not limited to: 

• Reliability for tests with polytomous items with different weights 

• Multidimensional response time analysis for test security - Detecting anomalies in response time due to test-taking misbehavior while factoring out construct-irrelevant sources of variance like speediness 

• Standard setting methods - Exploratory analysis of cognition and test-taking strategy to improve ALD development 

• Improving cut score decisions via machine learning - Using ranking algorithms to improve precision and consistency of cut score decisions in standard setting 

• Expanding item parameter drift detection tool into a full R package 

• Exploring maximization methods for IRT scoring 

• Investigation of psychometric qualities of reported subscores or domain scores using both simulated and real data 

• Exploring methods to detect invalid essay responses using deep learning models 

• IRT equating for mixed-format tests with weights 

• Standard setting using AI 

• Panelists experience under Evidence-Based Standard Setting 

• Detection of AI usage in free response questions 

Internship Details 

• Duration: Eight weeks (June 3–July 26, 2024) 

• Location: Remote with two REQUIRED one-week on-site residencies at the College Board Psychometrics office in New York City at the beginning of the internship on June 3-7 and at the end on July 22-26. The College Board will cover travel expenses for the residencies. 

• Paid/full-time summer internship 

• Positions: 2 

• Hours per week: 40 hours per week 

• The application deadline is March 8, 2024. Please submit a resume and cover letter. 

• Applicants will be informed about acceptances by April 5, 2024 

Minimum Qualifications 

To be eligible: 

• Interns must be full-time doctoral students at an accredited 4‐year university 

• A strong preference will be made toward advanced students in the process of completing their dissertations 

• Graduate students in psychometrics, measurement, quantitative & mathematical psychology, educational psychology, industrial‐organizational psychology, statistics, or related fields are invited to submit applications 

• Experience with statistical software (SAS, SPSS, R, and/or Python) is required, and working knowledge of Classical Test Theory and Item Response Theory is desired 

• Be able to work the entire internship period, including both on-site periods 

• Students must be eligible to be legally employed in the United States (international F1 visa students, please read details below) 

• Selected applicants must present proof of identity and valid work authorization in the United States (which may include CPT and OPT) to be admitted to the internship program. 

• The College Board is committed to diversity in the workplace and is an Equal Opportunity Employer. The College Board participates in E-Verify, a service of DHS and SSA, where required.  

 About Our Process  

• Application review will begin immediately and will continue until the position is filled 

• While the hiring process may vary, it generally includes: resume and application submission, recruiter phone screen, hiring manager interview, performance exercise and/or panel interview, and reference checks. This is an approximat