Psychometrician

POSITION OVERVIEW

NBME®'s Psychometrics and Data Analysis (PADA) unit is seeking a Psychometrician to join their team. When applying, interested candidates should include a cover letter to indicate their interest in and fit for the role. This position is expected to make contributions in four primary areas:

• Planning and execution of psychometric analyses, scoring, and score reporting for operational examination programs.
• Applied research and development in support of examination programs, analysis methods, and procedures.
• Contribute to the educational measurement community via professional presentations and publications related to independent and organizational research agendas.
• Evaluate existing procedures for improvement opportunities and identify new methods or applications of technology to increase accuracy and efficiency of exam processing.

The Psychometrician role must effectively collaborate with a variety of internal staff, including data analysts, test developers, information technologists, and program managers. In addition, the psychometrician is expected to be skilled in supporting external facing communication and engagement with clients and subject matter experts from a wide range of medical and health care fields.

Operational examination programs at NBME include the United States Medical Licensing Examination®, an extensive medical school examination program that supports the assessment needs of US and international medical schools, and numerous client examinations primarily in support of medical specialties. The variety of assessment programs creates a wealth of data and opportunities for applied and theoretical research that can impact practice.

This role has been designated as primarily remote, meaning it generally does not require onsite work more than an average of 2-3 times per month and may require additional prescheduled onsite work. You are offered the flexibility to select if you prefer to work primarily remotely, hybrid, or onsite. We are open to considering candidates in the following states: Pennsylvania, New Jersey, Delaware, Maryland, Florida, Georgia, Iowa, Indiana, Kansas, Kentucky, Michigan, North Carolina, South Carolina, Tennessee, Texas, and Virginia.

At NBME, we continue to innovate and improve how we fulfill the evolving needs of the health care community. This commitment starts and ends with the people at NBME. By recruiting and empowering talented individuals from various disciplines and backgrounds, which includes professionals with diverse life experiences, abilities, and perspectives, NBME can take a well-informed, robust approach to advancing medical education and assessment for years to come.

QUALIFICATIONS

Skills and Abilities

• Strong background in psychometric theory and application, including knowledge of IRT, CTT, statistics, test development procedures, and research design.

• Advanced knowledge of measurement topics such as equating, scaling, generalizability theory, Bayesian methodology, or standard setting.

• Knowledge and/or experience in natural language processing, process data analytic methods, or formative assessment approaches is desirable.
• Excellent computer skills and a working knowledge of statistical software (e.g., Calibration software, SAS, Python, R).
• Excellent oral and written communication skills.
• Ability to identify errors and solve problems.
• Excellent interpersonal skills, including the ability to work closely and successfully with individuals from a variety of professional and educational backgrounds.

Experience

A minimum of one year of experience is required to be considered for Psychometrician. Rank and responsibilities will be commensurate with experience.

Education

Doctorate degree in Educational/Psychological Measurement, Statistics, or a related field is required. Candidates who are ABD and near completion are encouraged to apply.

About NBME

NBME is a not-for-profit organization that specializes in the creation of assessments and learning tools for physicians and health professionals. Our mission is to advance assessment of these professionals to achieve optimal care for all, supporting the development of a highly effective, diverse and compassionate health care workforce.

Founded in 1915