AI Compiler Engineering Lead - Distinguished Engineer

Invent the future with us.    Recognized by Fast Company’s 2023 100 Best Workplaces for Innovators List, Ampere is a semiconductor design company for a new era, leading the future of computing with an innovative approach to CPU design focused on high-performance, energy efficient, sustainable cloud computing.   By providing a new level of predictable performance, efficiency, and sustainability Ampere is working with leading cloud suppliers and a growing partner ecosystem to deliver cloud instances, servers and embedded/edge products that can handle the compute demands of today and tomorrow.   Join us at Ampere and work alongside a passionate and growing team — we’d love to have you apply!   About the role:   Ampere is looking for an enthusiastic and highly-skilled AI Compiler Engineering Lead to join our expanding AI/LLM Compiler Team.  In this role, you will spearhead the ongoing design and development of advanced compilers for Ampere's upcoming AmpereOne Aurora products. Your responsibilities will include managing the compiler architecture, making substantial contributions to its backend development, and expanding the team.  You will work closely with Ampere’s hardware engineering design teams to develop a “best in class” algorithm-compiler-hardware ecosystem.  What you’ll achieve:  

• Successfully develop and deliver a functional AI compiler (either ahead-of-time or just-in-time) along with an associated runtime environment, ensuring robust performance and reliability. 
• Lead the Ampere Computing AI compiler software efforts, driving innovation and excellence in Ampere’s compiler technology. 
• Work hand-in-hand with the silicon design team to enhance the Ampere Aurora AI accelerator, contributing to cutting-edge hardware-software integration. 
• Design and implement advanced solutions and enhancements for prominent machine learning libraries, including Llama.cpp, PyTorch, JAX, vLLM, and ONNX (C++), significantly boosting their performance and capabilities. 
• Conduct in-depth analyses of neural network models, identifying and proposing optimizations at multiple levels including model architecture, framework efficiency, compilation process, and execution speed, leading to substantial performance improvements. 

About you:  

• Master's or PhD degree in Computer Science, Electrical Engineering, Mathematics, or a similar quantitative field and 15 years of overall software engineering experience. 
• Strong Proficiency in Python and C/C++ Languages: Bring your expertise and passion for programming with at least 4 years of hands-on experience in Python and C/C++, driving innovative solutions through powerful code. 
• Experience with Large-Scale Software Systems: Showcase your background working on substantial software projects, especially in the realm of compilers or domain-specific compilers, contributing to robust, high-performance systems. 
• Knowledge of Essential Tools: Demonstrate your command of vital development tools such as Linux, Git, GCC, and LLVM, ensuring smooth, efficient workflows and high-quality results. 
• Adaptability in a Startup Environment: Thrive in our fast-paced, dynamic startup culture where your ability to take initiative and achieve impactful results is highly valued and rewarded. 
• Familiarity with Machine Learning and Deep Learning: Leverage your expert knowledge of machine learning and deep learning, with hands-on experience in popular frameworks like TensorFlow, PyTorch, Llama.cpp, and vLLM, to drive groundbreaking advancements in AI technologies. 

What we’ll offer:   At Ampere we believe in taking care of our employees and providing a competitive total rewards package that includes base pay, bonus, equity, and comprehensive benefits. The full base pay range for this role is between $195,400 and $325,600, except in the San Francisco Bay Area where the range is between $201,400 and $335,600. We offer an annual bonus program tied to internal company goals and annual meritocratic equity awards that enable our employees to participate in the success of the company. Our benefits include health, wellness, and financial programs that support employees through every stage of life, with full benefits eligibility at 20 hours per week. Benefits highlights include:  

• Premium medical, dental, vision insurance, as well as income protection and a 401K retirement plan, so that you can feel secure in your health and financial future  
• Unlimited Flextime and 10+ paid holidays so that you can embrace a healthy work-life balance   
• A variety of healthy snacks, energizing espresso, and refreshing drinks to keep you fueled and focused throughout the day  

And