Senior Psychometrician

✨ Where do we hire from? Find out more about hiring at TestGorilla.
Please note for these roles, we are also open to hiring in Spain, Portugal, the Netherlands, and the UK.

Hi there, I'm Claudia, VP of Product at TestGorilla. We’re excited to share more about
the Senior Psychometrician role and our team.

About TestGorilla

Imagine a world where everyone lands their dream job. TestGorilla is empowering one billion people to do just that, as we revolutionize the hiring process with skills-based talent discovery. Our platform discovers, evaluates, and matches talent to dream jobs based on who they really are and what they can truly do. We combine sourcing, screening, and scientifically-validated assessments to reveal the complete picture of each candidate.

Unlike hiring tools that focus on experience and rely on assumptions, TestGorilla surfaces the best talent with the most relevant skills, giving teams the context they need to hire smarter, faster, and more fairly. We stand for diversity, act with integrity, and put talent first. We celebrate individuality and creativity and believe in a workplace where you can make a big impact. Our team works in a flexible, autonomous environment with a focus on well-being and results.

It’s an exciting time to join TestGorilla. Right now, we’re working hard to unlock the next phase of our growth. With thousands of customers and millions of candidate profiles, the potential of our platform has never felt greater! Join us in creating a future where skills matter most, and everyone has the chance to land their dream job.

About the role

As our Senior Psychometrician, you will bring advanced expertise in psychometrics to ensure the scientific rigor, reliability, validity, and fairness of our assessments. You will work both independently and collaboratively with our existing Psychometrician and cross-department team members to deliver high-quality scientific assessment. This role is ideal for someone with strong technical skills in psychometrics, the ability to integrate various aspects of assessment science, and interested to grow into leadership responsibilities over time. 

You will directly contribute to our mission by ensuring our assessments remain world-class, legally defensible, and innovative in both technical and scientific ways --helping one billion people find their dream jobs.

Responsibilities

In this role, your responsibilities will include but not limited to:

• Lead psychometric oversight for AI-evaluation tools, including automated scoring of open-ended questions, AI testing, and candidate recommendation models
• Collaborate with data scientists and engineers to design, validate, and monitor AI-powered scoring systems and candidate evaluations for fairness, transparency, and predictive validity.
• Contribute to assessment innovation while maintaining scientific integrity and compliance with legal and ethical standards.
• Integrate various aspects of psychometric science to provide cohesive, high-quality solutions.
• Lead and execute scientific studies in psychometrics, including reliability and fairness analyses of assessments.
• Act as the primary expert and point of contact for psychometric rigor in the team, while mentoring the existing team member.
• Collaborate with data scientists, engineers, and product managers to embed psychometric principles effectively in our AI-first platform.
• Uphold TestGorilla's behaviors and foster an inclusive, supportive culture.
• Collaborate effectively with global colleagues across teams and time zones.
  

What you’ll bring

We're looking for someone who:

• Is passionate about TestGorilla's mission to help one billion people find their dream jobs.
• Has strong written and verbal communication skills in English.
• Thrives in a fast-paced, remote-first environment.
• Skills and experience with psychometric applications in AI/ML environments.
• Strong expertise in psychometrics, with hands-on experience in designing, validating, and improving assessments.
• Familiarity with algorithmic fairness principles and the ability to apply statistical and psychometric techniques to evaluate bias in AI systems
• Capability to “bring it all together”, integrating different aspects of psychometric theory and practice to support business and product goals.
• Ability to work independently, handling responsibilities reliably without requiring extensive oversight.