Manager, Data Science

At MCG, we lead the healthcare community to deliver patient-focused care. We have a mission-driven team of talented physicians and technical experts developing our evidence-based content and innovating our products to accelerate improvements in healthcare. If you are driven to enhance the US healthcare system, MCG is eager to have you join our team. We cultivate a work environment that nurtures personal and professional growth, and this is a thrilling time to become a part of our organization. With dynamic roles that offer meaningful impact, you'll be able to fully realize your potential. Plus, you'll enjoy world-class benefits and the security, stability, and resources of our parent company, Hearst, with over 100 years of experience.

As Manager of Data Science, you will lead the team responsible for responsible for effectively testing our agents. You will lead Data Scientists and analysts as they build statistically sound evaluations, guide annotation, and develop ground truths for complex tasks. 

You Will:

• Direct annotation by managing annotation budgets, sourcing data, and providing statistical analysis of annotations
• Maintain and expand metrics used to evaluate agent performance and fairness 
• Create evaluation packages for Data Scientist and Machine Learning Engineers to use when running experiments 
• Ensure accurate, regular reporting on evaluation metrics to stakeholders 
• Manage periodic re-evaluation of production agents using user data and annotation 

Our tech stack 

• Primarily Python jobs and applications 
• OpenAI and other Foundation model APIs 
• Pytorch on AzureML for our own training 
• Kubernetes via AKS or EKS for serving compute (with support from infra team) 
• Databricks for data lake 
• Flyte for orchestration 

What We're Looking For:

• Expert level Python proficiency 
• Ability to write reliable, extensible python packages 
• Demonstrated experience translating high level requirements into useful tools 
• Excellent knowledge of frequentist and Bayesian statistical techniques 
• Healthcare experience 
• Good written communication skills 

Preferred Qualifications:

• Experience with basic principles of deep learning and/or natural language processing 
• Experience working specifically on automated model evaluation

Pay Range: $146,700 - $205,400

Other compensation: Bonus Eligible/ Commission Eligible   

Perks & Benefits:  

💻 Remote work

✈️ Travel expected 3-4 times per year for company-sponsored events 

🩺 Medical, dental, vision, life, and disability insurance 

📈 401K retirement plan; flexible spending and health savings account 

🏝️ 15 days of paid time off + additional front-loaded personal days 

🏖️ 14 company-recognized holidays + paid volunteer days  

👶 up to 8 weeks of paid parental leave + 10 weeks of paid bonding leave  

🌈 LGBTQ+ Health Services 

🐶 Pet insurance  

📣 Check out more of our benefits here: https://www.mcg.com/about/careers/benefits/  

Remote with Occasional Travel (1–3 trips per year) 

MCG Health is a Seattle, Washington-based company and is considering remote candidates with some travel for company-sponsored events.  

The ideal candidate should be comfortable balancing the independence of remote work with the collaborative opportunities offered by periodic in-person engagements. 

We embrace diversity and equal opportunity and are committed to building a team that represents a variety of backgrounds, perspectives, and skills. Only with diverse thoughts and ideas will we be able to create the change we want in healthcare. The more inclusive we are, the better our work will be for it.