Senior Manager, Machine Learning Engineering

Center 3 (19075), United States of America, McLean, Virginia

Senior Manager, Machine Learning Engineering

As a Capital One Machine Learning Engineer (MLE), you'll be part of an Agile team dedicated to productionizing machine learning applications and systems at scale. You’ll participate in the detailed technical design, development, and implementation of machine learning applications using existing and emerging technology platforms. You’ll focus on machine learning architectural design, develop and review model and application code, and ensure high availability and performance of our machine learning applications. You'll have the opportunity to continuously learn and apply the latest innovations and best practices in machine learning engineering. 

Team Info:

The Enterprise Machine Learning Tools team is responsible for developing and maintaining enterprise grade tools and capabilities for Data Scientists and Model Developers across different lines of business in Capital One. The tools are developed using Python and rely on the sklearn framework. If you have strong Python skills and are inspired to ensure the tools developed are scalable, optimized and align to engineering best practices and can be easily used by Data Scientists then this is the team for you!

What you’ll do in the role: 

The MLE role overlaps with many disciplines, such as Ops, Modeling, and Data Engineering. In this role, you'll be expected to perform many ML engineering activities, including one or more of the following:

• Design, build, and/or deliver ML models and components that solve real-world business problems, while working in collaboration with the Product and Data Science teams. 

• Inform your ML infrastructure decisions using your understanding of ML modeling techniques and issues, including choice of model, data, and feature selection, model training, hyperparameter tuning, dimensionality, bias/variance, and validation).

• Solve complex problems by writing and testing application code, developing and validating ML models, and automating tests and deployment. 

• Collaborate as part of a cross-functional Agile team to create and enhance software that enables state-of-the-art big data and ML applications. 

• Retrain, maintain, and monitor models in production.

• Leverage or build cloud-based architectures, technologies, and/or platforms to deliver optimized ML models at scale.

• Construct optimized data pipelines to feed ML models. 

• Leverage continuous integration and continuous deployment best practices, including test automation and monitoring, to ensure successful deployment of ML models and application code. 

• Ensure all code is well-managed to reduce vulnerabilities, models are well-governed from a risk perspective, and the ML follows best practices in Responsible and Explainable AI. 

• Use programming languages like Python. 

Basic Qualifications:

• Bachelor’s degree 

• At least 8 years of experience designing and building data-intensive solutions using distributed computing (Internship experience does not apply)

• At least 4 years of experience programming with Python, Scala, or Java

• At least 3 years of experience building, scaling, and optimizing ML systems

• At least 2 years of experience leading teams developing ML solutions

• At least 4 years of people management experience. 

Preferred Qualifications:

• Master's or doctoral degree in computer science, electrical engineering, mathematics, or a similar field 

• 4+ years of on-the-job experience with an industry recognized ML framework such as scikit-learn, PyTorch, Dask, Spark, or TensorFlow 

• 2+ years of experience with container & image management (AWS EKS, Kubernetes, Docker)

• 3+ years of experience developing performant, resilient, and maintainable code

• 3+ years of experience with data gathering and preparation for ML models

• Experience developing and deploying ML solutions in a public cloud such as AWS, Azure, or Google Cloud Platform 

• 3+ years of experience building production-ready data pipel