Assessment Data Analyst I

POSITION OVERVIEW

NBME is currently seeking an Assessment Data Analyst I to join our Test Development team. This position will provide analysis, test construction/publication services, and system support for various exam programs that include multiple-choice questions. The exams mentioned include The United States Medical Licensing Examination, North American Veterinary Licensing Examination, Medical School Services, and NBME Self-Assessment Services.

This role is primarily remote, requiring minimal onsite attendance except for quarterly change of pace days, which are mandatory for all employees in the organization. While this role can be designated as remote, you are offered the flexibility to select if you prefer to work primarily remotely, hybrid, or onsite. We're open to considering candidates within 90 miles of our office location in Philadelphia, PA.

Diversity, Equity, and Inclusion Statement

At NBME ®, we continue to innovate and improve how we fulfill the evolving needs of the health care community. This commitment starts and ends with the people at NBME. By recruiting and empowering talented individuals from various disciplines and backgrounds, which includes professionals with diverse life experiences, abilities, and perspectives, NBME can take a well-informed, robust approach to advancing medical education and assessment for years to come. We also continue to focus on ensuring that our DEI work is impactful and ingrained in everything we do, including with our staff, workplace culture, products and services, the Philadelphia community and the broader medical education landscape.

RESPONSIBILITIES

• Perform analyses by extracting data from our databases and data warehouses using R to generate the results
• Communicate results to non-technical members of the organization
• Execute automated assembly of test forms
• Analyze the statistical and content characteristics of the new forms using R, Python, and Excel
• Create, update, and disseminate documentation for new and existing technological procedures and routines, including direct user support and training
• Collaborate with other units in the research, design, and testing of new technology and software.
• Monitor implementation of new technology, systems, and software

QUALIFICATIONS

Skills and Abilities

• Significant expertise with software applications supporting data analysis/warehousing (R, Python, C#, Excel, SQL, CPLEX)
• Excellent interpersonal and communication skills including the ability to "translate" technical information to non-technical individuals
• Strong attention to detail and problem-solving skills
• Ability to learn and apply new technology quickly
• Ability to set priorities consistent with unit goals
• Some knowledge of and experience with the scholarly research process

Experience

• 3 to 5 years of relevant with programming at the level of the business unit
• Previous exposure with or knowledge about assessment, Item Response Theory (IRT) and Psychometrics
• Knowledge of optimized automated process with complex data, like Automated Test Assembly (ATA)

Education

• Bachelor's Degree

About NBME:

NBME offers a versatile selection of high-quality assessments and educational services for students, professionals, educators, regulators and institutions dedicated to the evolving needs of medical education and health care. To ensure our assessments meet the highest standards of quality, stay relevant and align to the current curriculum in medical schools and training programs, we rely on a wide network of collaborators. These include the volunteers who help develop our exam questions, the committees and panels who represent various groups within the medical education community, external researchers and health profession organizations.

We are committed to meeting the needs of educators and learners globally with assessment products and expert services such as NBME® Subject Examinations, Customized Assessment Services, Self-Assessments, the International Foundations of Medicine® Program and Item Writing Workshops. Together with the Federation of State Medical Boards, NBME develops and manages the