Director, Exam Integrity

POSITION OVERVIEW

The Director of Exam Integrity plays a critical role in ensuring the security and validity of NBME's exam programs. Leveraging expertise in assessment, analytics, legal, and investigatory processes, this role leads exam security initiatives designed to protect NBME's exam products. Reporting directly to the Vice President of Operations Management, the Director collaborates with senior leadership and stakeholders to develop and implement robust security policies. This position requires strong decision-making skills, leadership, and the ability to operate independently while managing a team responsible for investigating, preventing, and mitigating exam security risks.

This role is primarily remote, requiring minimal onsite attendance. While this role can be designated as remote, you are offered the flexibility to select if you prefer to work primarily remotely, hybrid, or onsite. We're open to considering candidates within 50 miles of our office location in Philadelphia, PA.

Diversity, Equity, and Inclusion Statement

At NBME, we continue to innovate and improve how we fulfill the evolving needs of the healthcare community. This commitment starts and ends with the people at NBME. By recruiting and empowering talented individuals from various disciplines and backgrounds, which includes professionals with diverse life experiences, abilities, and perspectives, NBME can take a well-formed, robust approach to advancing medical education and assessment for years to come. We also continue to focus on ensuring that our DEI work is impactful and ingrained in everything we do, including with our staff, workplace culture, products and services, the Philadelphia community, and the broader medical education landscape.

RESPONSIBILITIES

• Leadership & Strategy: Provide thought leadership on exam security, serving as a change agent and advocate for the Exam Integrity office. Collaborate with exam program leaders and other stakeholders to identify security risks and implement effective strategies that align with the stakes of each exam.
• Team Management: Lead a team of exam integrity professionals, offering guidance and support while fostering a culture of continuous improvement. Conduct performance reviews, provide mentorship, and ensure the team stays current on industry best practices.
• Security Investigations: Direct and oversee investigations of security incidents, utilizing resources efficiently to mitigate risks. Work closely with legal and other departments to resolve incidents and mitigate the likelihood of future reoccurrence.
• Stakeholder Collaboration: Build and maintain strong relationships with key stakeholders, including program management, content development, IT, legal, and psychometrics teams. Ensure cross-departmental alignment on security protocols and foster open communication.
• Policy Development: Develop and implement exam security operational policies and procedures that encompass prevention, deterrence, detection, and investigation. Ensure these policies are consistently applied across all exam programs.
• Industry Engagement: Represent NBME at relevant industry conferences and events, staying informed on the latest trends and challenges in exam security. Apply these insights to continually enhance NBME's security posture.

QUALIFICATIONS

Skills and Abilities

• Assessment Expertise: Understands core assessment processes (content development, psychometrics, exam delivery) and ensures alignment with security protocols.
• Investigative & Legal Proficiency: Strong investigatory skills, including gathering and analyzing evidence, conducting detailed investigations, and compiling comprehensive reports. Experience working with legal teams and senior leadership to address security incidents.
• Data Analysis & Technical Skills: Proficiency in data analysis tools and methodologies to detect anomalies and security risks. Strong knowledge of psychometrics and exam validation processes.
• Risk Management: Adept at identifying, assessing, and mitigating exam security risks to protect the integrity and validity of high-stakes exams.
• Communication & Leadership: Ability to communicate complex security issues clearly to senior leaders, stakeholders, and team members. Demonstrated leadership skills, including team management, delegation, and performance feedback.
• Strategic Thinking & problem solving: Ability to make informed decisions in high