Senior NLP Scientist

POSITION OVERVIEW

The Office of Research Strategy (ORS) at NBME® is currently recruiting a Senior NLP Scientist to contribute to groundbreaking assessments in the healthcare domain. In this role, you will help advance the development of state-of-the-art assessments by leveraging Natural Language Processing (NLP), Machine Learning (ML), and data science to solve challenges in educational testing and evaluation. Projects will range from automated scoring systems and AI-driven question generation to the analysis of process data, immersive simulations, and interactive educational tools. This position also fosters applied research collaborations that integrate psychometrics, data science, and measurement science, all aimed at improving the credentialing of healthcare professionals.

As a Senior NLP Scientist, you will bring your expertise in both research and technical development to contribute to the creation of cutting-edge educational technologies and help guide innovative research programs within NBME. This role is ideal for individuals eager to contribute to impactful research within a dynamic, collaborative environment focused on the future of medical assessments.

This role is primarily remote, requiring little to no onsite attendance. Employees have the flexibility to choose between remote, hybrid, or onsite work. Candidates living in the following states: California, Colorado, Connecticut, Massachusetts,
New York, North Dakota, Ohio, Rhode Island 
Washington, Washington D.C (District of Columbia), or Wyoming will need to relocate before starting.

Diversity, Equity, and Inclusion Statement

At NBME, we continue to innovate and improve how we fulfill the evolving needs of the health care community. This commitment starts with the people at NBME. By recruiting and empowering talented individuals from various disciplines and backgrounds, which includes professionals with diverse life experiences, abilities, and perspectives, NBME can take a well-informed, robust approach to advancing medical education and assessment for years to come. We also continue to focus on ensuring that our DEI work is impactful and ingrained in everything we do, including with our staff, workplace culture, products and services, the Philadelphia community, and the broader medical education landscape.

RESPONSIBILITIES

• Spearhead research initiatives that align with NBME's broader mission, focusing on cutting-edge assessments using NLP, ML, and data-driven methodologies.
• Lead the development and testing of new products and research prototypes, transforming conceptual models into real-world applications.
• Serve as an NLP and ML expert, guiding cross-disciplinary collaboration between data scientists, psychometricians, engineers, product developers, and external partners.
• Actively contribute to scientific discourse through peer-reviewed publications and presentations at premier conferences such as ACL, EMNLP, and NAACL.
• Mentor junior researchers, providing direction on research strategies, technical skills, and career development.

QUALIFICATIONS

Skills and Abilities

• A strong academic or industry background, with 5+ years of experience in NLP, machine learning, data science, or computer science.
• Proven proficiency in Python or equivalent programming languages used for NLP and ML research.
• Demonstrated experience in driving research from initial concept to deployment of operational applications, particularly in areas involving automated scoring or content generation.
• Strong track record of research contributions, including peer-reviewed publications in prestigious NLP or ML journals and conferences.
• Exceptional communication and collaboration skills, with the ability to work effectively across different professional disciplines.

Education

• PhD in Natural Language Processing, Computational Linguistics, Computer Science, Clinical Informatics, or a closely related field is required.

About NBME:

NBME offers a versatile selection of high-quality assessments and educational services for students, professionals, educators, regulators, and institutions dedicated to the evolving needs of medical education and health care. To ensure our assessments meet the highest standards of quality, stay relevant and align to the current curriculu