Sr. Machine Learning Knowledge Engineer

Why Glassdoor?

When you work for Glassdoor, you help people everywhere get ahead in work and life. That’s because we’re moving fast to become the leading community for workplace conversations. Every day, we foster radical transparency by giving professionals a platform to connect authentically and anonymously. Think real talk with real people — plus company reviews and ratings, salary info, job listings and more. 

Join us as we make worklife better, together.

About the Role

We're looking for a creative and versatile Senior Machine Learning Knowledge Engineer to join our team. You'll bring a background in machine learning or AI data analysis and participate in a variety of projects including building and refining taxonomies, classifying online content, analyzing search behavior, and researching salaries and responsibilities for a wide range of occupations. 

You will be part of the team that creates and curates ML model and generative AI training data, and measures and improves the quality of  products. We partner with product managers, machine learning scientists, and a team of data annotators to create models that improve relevance, generate classifications and improve user experience on our platforms. 

What You’ll Do:

• Work with product managers to understand product requirements and use cases, determine whether ML or AI is an appropriate solution, and coordinate project execution and resource management
• Become a subject matter expert on various topics related to careers and social media discussion by diving deep into data
• Curate data sets for model training and development with attention to mitigating bias
• Create and maintain taxonomies as needed for model development using industry best practices
• Audit and refine existing taxonomies as needs and use cases change
• Design and operationalize annotation and model evaluation tasks, including creating guidelines, auditing annotation work, and adhering to best practices
• Provide data-driven analysis and insights from data and evaluations and offer solutions  to improve the quality of our ML and AI models
• Advocate for the importance of human-in-the-loop during model development and explain why and where this is necessary to product stakeholders
• Work autonomously with minimum direction.
• Engineer prompts to guide generative AI to produce desired outputs in context, and evaluate generative AI output
• Automate operations and perform data analysis using python and SQL

What You’ll Bring:

• A commitment to add to our culture of DEI
• 5+ years of experience focusing on natural language processing, taxonomy and ML model analysis
• A data-driven analytical mindset, and the ability to communicate complex data trends in effective ways to product stakeholders
• Solid understanding of the ML model development life cycles
• Experience overseeing teams of human data labelers, creating annotation guidelines, and performing audits and quality control for data annotation teams
• Experience working with data from social media platforms
• An appreciation for the nuances of human language and comfort with navigating ambiguity in syntax, semantics and categorization
• A background in linguistics, library science, or information retrieval
• Working knowledge of Python, SQL, and command line operations
• Familiarity with occupational taxonomies, employee benefits, and career industries

Compensation and Benefits

Base salary range*: $122,100.00 - $162,200.00

Glassdoor base salaries are targeted to the market 75th percentile for technical roles and the 65th percentile for non-technical roles. In other words, 65-75% of comparable organizations in our industry will pay less.

Annual bonus target**: 10%

**Bonuses are paid in 6-month intervals, aligning with bi-annual performance reviews

Generous Restricted Stock Units (RSU):

***Restricted Stock Units (RSU) are awarded at hire and may be refreshed annually. Additionally, as a pay-for-performance company, there are additional RSU grant awards for the very top performers.

You can learn more about our compensation philosophy here and see salary ranges for all Glassdoor jobs here.

Health and wellness: 100% employer-paid premiums for employee medical, dental, vision, life, short and long-ter