Jobs and Careers
MI

Software Engineer II and Senior Software Engineer - AI Compilers

Microsoft
New York City, United StatesRemotefull_timeVerifiedPosted 13 Mar 2026
💰 $258,000/yr($100,600/yr$258,000/yr)

About the role

Overview

The AI Frameworks team at Microsoft develops the AI software used to train and deploy the world’s most advanced AI models. We build state-of-the-art AI compilers and design new AI programming abstractions for Microsoft’s next-generation supercomputers and the Maia-200 AI accelerator. Our interdisciplinary team operates at the intersection of compiler engineering, programming language design, algorithmic innovation, AI, and high-performance computing. Our culture is highly collaborative and we regularly partner with hardware architects, platform engineers, researchers, and other groups across Microsoft. We also participate in the open-source community.

We are seeking talented and collaborative Software Engineers to join our AI Compiler group. This is a unique opportunity to join a dynamic team, working on cutting-edge technology that has a direct impact on every Microsoft business.

Employees who live within 50 miles of Redmond, Mountain View, Boston, and NYC are expected to be in the office 3 days a week. Employees who live more than 50 miles from a Microsoft hub may work fully remotely.



Responsibilities

As a Software Engineer on the AI Compilers team you will have the opportunity to work on the following:

  • Invent and implement innovative compiler features and advanced optimization passes, leveraging tools such as LLVM, MLIR, Torch Dynamo, and Triton.
  • Develop code generation techniques for new hardware platforms.
  • Design and develop cutting edge AI software in C++ and Python.
  • Optimize AI workloads.
    Design new programming abstractions for AI.
  • Collaborate broadly across multiple disciplines from hardware architects to ML developers.
  • Identify requirements, plan and design solutions, estimate effort, and schedule deliverables.
  • Help establish and drive the adoption of outstanding coding standards and patterns and help enhance our inclusive engineering culture.
  • Embody Microsoft's culture and values


Qualifications

Required Qualifications

  • Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, or Python OR equivalent experience.

Other Requirements

Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings: 

Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Preferred Qualifications

  • Master's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, or Python OR Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, or Python OR equivalent experience.
  • Master’s Degree or PhD in Computer Science or related technical field AND 3+ years technical software engineering experience OR Bachelor's Degree in Computer Science or related technical field AND 5+ years technical software engineering experience OR equivalent experience.
  • 3+ years experience programming in C/C++.
  • 1+ years experience with optimized systems‑level programming.
  • Experience building compilers, using compiler frameworks like LLVM/MLIR, OR experience optimizing AI/numerical workloads, OR experience in numerical high-performance computing.
  • Experience with AI frameworks, AI inference systems, AI kernel development, and AI workload optimization.

#aifx



Software Engineering IC3 - The typical base pay range for this role across the U.S. is USD $100,600 - $199,000 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $131,400 - $215,400 per year.

Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here:
https://careers.microsoft.com/us/en/us-corporate-pay

Software Engineering IC4 - The typical base pay range for this role across the U.S. is USD $119,800 - $234,700 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $158,400 - $258,000 per year.

Certain roles may b

Apply for this role

Generate a tailored application kit with a matched cover letter, interview prep, and CV highlights — in under 60 seconds.

Apply Now →Generate Application Kit

Free account required — sign up in 30s

Company

Microsoft

View company profile →