ML Ops Engineer, HPC

About Stability:

Stability AI is a community and mission driven, open-source artificial intelligence company that cares deeply about real-world implications and applications. Our most considerable advances grow from our diversity in working across multiple teams and disciplines. We are unafraid to go against established norms and explore creativity. We are motivated to generate breakthrough ideas and convert them into tangible solutions. Our vibrant communities consist of experts, leaders and partners across the globe who are developing cutting-edge open AI models for Image, Language, Audio, Video, 3D and Biology.

About the role:

We are seeking a talented ML Ops Engineer with a strong focus on High Performance Computing (HPC) to join our team. The primary responsibility of this role is to effectively bridge the gap between our engineering teams, ensuring smooth integration and operation of Machine Learning models within a High Performance Computing environment. The ideal candidate will oversee the deployment of serving and training tools for deep learning models, along with managing necessary adjustments in the hosting infrastructure to optimize performance.

Responsibilities:

• Collaborate closely with the engineering teams to facilitate seamless interaction and integration of Machine Learning model serving and training within the HPC environment.
• Manage and optimize the deployment of training and inference tools, ensuring they function efficiently within the designated infrastructure.
• Implement necessary changes in the hosting infrastructure to accommodate the specific requirements of ML models, ensuring they operate effectively in both cloud and HPC environments.
• Enable harmonious co-functioning of cloud services and HPC systems, allowing them to operate independently without affecting each other. 
• Ensure successful integration of inference containers and resources, allowing for simultaneous operations in a unified manner.
• Actively engage in performance optimization in Deep Learning, leveraging a deep understanding of compilers and their role in maximizing efficiency.
• Provide technical expertise in Linux, SLURM, and experience with AWS or GCP infrastructure, optimizing the environment for ML operations.
• Collaborate with the broader team to design, build, and maintain efficient and scalable systems to support Machine Learning models' deployment and execution.
• Demonstrate proficiency in coding languages such as Python, C++, and TypeScript, ensuring the development and management of various tools and integrations.

Requirements:

• Proficiency in programming languages like Python, C/C++ and TypeScript
• Experience working in cloud based environments such as AWS, GCP, Cloudflare, etc. 
• Experience with  HPC cluster management tools like Slurm and in systems like Linux
• Familiarity with GPU’s and other accelerators like Gaudi2 and TPU’s
• Solid experience in managing and coordinating with cross-functional teams in a fast-paced environment.
• Ability to troubleshoot and resolve complex technical issues in an HPC setting, ensuring the continuous smooth operation of ML models.
• Proven track record in designing and implementing solutions for high availability, scalability, and performance.
• Strong communication skills and the ability to convey complex technical concepts to non-technical stakeholders.
• Familiarity with Agile methodologies, allowing for quick adaptation to evolving project requirements.

Equal Employment Opportunity:

We are an equal opportunity employer and do not discriminate on the basis of race, religion, national origin, gender, sexual orientation, age, veteran status, disability or other legally protected statuses.