Advanced Doctoral Psychometrics Intern (10-month)

Advanced Doctoral Psychometrics Intern (10-month) 

College Board – Learning & Assessment/Psychometrics  

Location: This is a fully remote role. At the discretion of the candidate’s mentor, there could be an opportunity to attend two optional on-site one-week residencies at our New York City office.  

Type:  

• This is an internship position that will last 10 months from the start date beginning in September and ending in June. Interns will be expected to work 32 hours a week and the internship will coincide with the student’s school schedule. 

Application Deadline: Friday, August 9th at 5pm EST 

About the Team  

The Psychometrics Team supports College Board in serving more than seven million students a year as they prepare for a successful transition to college through programs and services in college readiness and college success. College Board’s Psychometrics provides its partners with measurement solutions that set the standard for quality, efficiency and innovation through operational excellence and research leadership that advances the field of Psychometrics and supports College Board’s mission of access and equity in Education. 

About the Opportunity  

The internship spans the entire academic year, with an expected weekly load of 32 hours per week (four days a week). This internship is designed to provide the intern with the opportunity to work closely with psychometricians and to gain hands-on working experience with College Board data and research projects in support of College Board programs. The intern is expected to perform operational psychometric tasks with the guidance of the two mentors. The tasks may include but are not limited to standard setting, test analysis, review of technical manuals, literature review and conducting research studies. 

As an intern you will be part of one of the four teams in the Psychometrics department at College Board.  

These teams are  

• AP Psychometrics 

• SAT Psychometrics, Analytics, and Research 

• CLEP and ACCUPLACER Psychometrics & Research 

• Psychometric Technology and Analytics 

You may also work directly with the Robert L. Brennan Chair of Psychometrics who consults and works with all of the four teams on multiple projects. 

Current ongoing projects for which you may have an opportunity to work on include 

• Reliability for tests with polytomous items with different weights 

• Multidimensional response time analysis for test security - Detecting anomalies in response time due to test-taking misbehavior while factoring out construct-irrelevant sources of variance like speededness 

• Standard setting methods - Exploratory analysis of cognition and test-taking strategy to improve ALD development 

• Improving cut score decisions via machine learning - Using ranking algorithms to improve precision and consistency of cut score decisions in standard setting 

• Expanding item parameter drift detection tool into a full R package

• Exploring maximization methods for IRT scoring 

• Investigation of psychometric qualities of reported subscores