Staff ML Model Risk Specialist

About Upstart

Upstart is a leading AI lending marketplace partnering with banks and credit unions to expand access to affordable credit. By leveraging Upstart's AI marketplace, Upstart-powered banks and credit unions can have higher approval rates and lower loss rates across races, ages, and genders, while simultaneously delivering the exceptional digital-first lending experience their customers demand. More than two-thirds of Upstart loans are approved instantly and are fully automated.

Upstart is a digital-first company, which means that most Upstarters live and work anywhere in the United States. However, we also have offices in San Mateo, California; Columbus, Ohio; and Austin, Texas.

Most Upstarters join us because they connect with our mission of enabling access to effortless credit based on true risk. If you are energized by the impact you can make at Upstart, we’d love to hear from you!

The Team: 

Upstart’s ML Model Risk team is responsible for ensuring that the risk of machine learning (ML) models at Upstart is well-understood, monitored, and mitigated, which requires deep understanding of the models themselves. This work is essential for Upstart’s internal risk management, ensuring that our models help us make better decisions, and to maintain credibility with external stakeholders such as our lending partners and regulators. The team’s focus is on articulating sound model risk management principles and implementing them in collaboration with our peers on Upstart’s Risk and Machine Learning teams. This work also includes explaining our ML models to stakeholders, supporting external validations, and conducting analyses to reinforce our goals.

As a Staff ML Model Risk Specialist at Upstart, you will play a critical role in making robust model risk management a reality by leading day-to-day implementation of Upstart’s model risk management program. This work includes partnering with our Machine Learning teams to meet model risk management requirements, with tasks ranging from producing robust model documentation, assisting with monitoring and validation efforts, and partnering with other Upstart stakeholders to understand model risk management needs across the enterprise.

How you’ll make an impact

• Partner with model developers in the Machine Learning team to maintain robust and up-to-date model inventory, model risk assessments, documentation, and monitoring reports. For instance, ensure that documentation is both technically adequate and comprehensible to stakeholders with varying needs and levels of technical sophistication.
• Partner with ML teams to provide effective challenge of Upstart’s models and communicate modeling assumptions to external stakeholders.
• Answer model questions from lending partners, in collaboration with other teams.
• Partner with central Upstart’s Legal and Compliance teams as needed to ensure our model risk management  implementation meets or exceeds Upstart’s internal policies as well as regulatory requirements.

Minimum Qualifications 

• Master’s degree in quantitative field such as finance, mathematics, economics, statistics or a related discipline
• 4+ years of experience in model risk management or model governance, or related fields such as ML and Data Science, Risk, Trust and Safety, or Technical Writing
• Understanding of AI/ML methodologies such as tree-based models and neural networks
• Experience coding in R, Python, or similar languages such as Matlab

Preferred Qualifications

• PhD in a quantitative field of study such as statistics, econometrics, finance, mathematics; or a related discipline
• 5+ years experience in similar roles
• Strong communication skills: ability to adapt technical information to varying needs and audiences, and managing trade-offs such as providing modeling detail while protecting intellectual property
• Proactive mindset with the ability to take initiative and drive projects forward
• Understanding of advanced AI/ML topics such as model monitoring, fairness, and explainability
• Advanced coding skills in R, Python, and SQL, and experience using Git
• Consumer lending knowledge and/or experience within an ML-centric technology company

What you'll love: 

• Competitive Compensation (base + bonus & equity)
• Comprehensive medical, dental, and vision coverage with Health Savings Account contributions from Upstart 
• 401(k) with 100% company match up to $4,500 and immediate vesting and after-tax savings
• Employee Stock Purchase Plan (ESPP)
• Life and disability insurance
• Generous holiday, vacation,