Senior Measurement Scientist

POSITION OVERVIEW

The Office of Research Strategy (ORS) at the NBME is currently seeking a Senior Measurement Scientist to join its team. ORS is responsible for developing next-generation assessments and conducting psychometric research related to these assessments. Areas of research and development in which ORS is involved include the assessment of professional competencies such as communication skills and clinical reasoning, technology-based assessments including simulations, and psychometric applications in the education, training, and credentialing of healthcare professionals including foci on construct development, validity issues, complex item-response theory models, and multilevel and structural equation modeling techniques.

This researcher will apply strong critical thinking skills and a working knowledge of best practices to the development of novel assessments of healthcare professionals.

Diversity, Equity, and Inclusion Statement

At NBME, we continue to innovate and improve how we fulfill the evolving needs of the healthcare community. This commitment starts and ends with the people at NBME. By recruiting and empowering talented individuals from various disciplines and backgrounds, which includes professionals with diverse life experiences, abilities, and perspectives, NBME can take a well-informed, robust approach to advancing medical education and assessment for years to come. We also continue to focus on ensuring that our DEI work is impactful and ingrained in everything we do, including with our staff, workplace culture, products and services, the Philadelphia community and the broader medical education landscape.

RESPONSIBILITIES:

• Plan and execute programs of research aligned with the ORS research agenda that center around the development of novel assessments for healthcare professionals

• Oversee and provide services to the measurement/medical education community by acting as reviewer or editor for professional journals and/or conference submissions and actively participating in professional conferences as presenter and discussant.

• Design studies and conduct analyses to improve test design and development, and scoring and score reporting for medical licensing examinations and related assessment programs;
• Provide psychometric consultation; and
• Contribute to the educational measurement community via professional presentations or publications related to independent or organizational research agendas.

QUALIFICATIONS:

Skills and Abilities

• Strong background in educational assessment and measurement, and/or in psychological assessment, including a well-developed understanding of issues of reliability, validity and other quantitative concepts of test and assessment quality; and
• Experience in developing assessments for a variety of purposes and uses, including formative purposes; and
• Experience developing performance-based assessments and learning tools, such as simulation-based assessments, and incorporating the latest technologies into the assessment design; and
• Demonstrated ability to define, develop, and execute approaches to assess and provide feedback on skill and behavior constructs important in medical education, particularly patient-centered communication skills; and
• Excellent oral and written communication skills as well as outstanding interpersonal skills, including the ability to work closely and successfully with individuals from a variety of professional and educational backgrounds.

Experience

• Minimum 5 years of experience

Education

• Doctorate in educational/psychological measurement, industrial/ organizational psychology, cognitive psychology or related field;

About NBME:

NBME offers a versatile selection of high-quality assessments and educational services for students, professionals, educators, regulators and institutions dedicated to the evolving needs of medical education and health care. To ensure our assessments meet the highest standards of quality, stay relevant and align to the current curriculum in medical schools and training programs, we rely on a wide network of collaborators. These include the volunteers who help develop our exam questions, the committees and panels who represent various groups within the medical education community, exter