Principal Software Engineer

As a Principal Software Engineer on the Azure Artificial Intelligence Core team at Microsoft, you will design, build, and maintain AI systems that power some of the largest workloads on the planet. We enable secure, scalable, and high-performance AI experiences across multimodal verticals, including real-time audio interaction, image generation, video generation and safety. Our work spans the entire stack—from API interfaces to inference backends serving AI models—delivering end-to-end solutions that drive innovation at scale.   

As part of the Azure OpenAI effort, we collaborate closely with OpenAI and internal partners to advance cutting-edge capabilities. Our team owns critical components such as the safety stack, providing content moderation across different verticals, and real-time APIs, enabling audio-based conversations with large language models through interfaces like SIP, WebSocket, and WebRTC. We benchmark OpenAI and other LLM models for performance on GPUs and Microsoft HW, working together with the inference team to debug and optimize our stacks for reliability and latency.   

This is a hands-on technical role requiring deep expertise in distributed systems and AI architectures. We are looking for engineers who thrive on solving complex problems, move fast with autonomy, and embrace collaboration across diverse teams.  

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

In alignment with our Microsoft values, we are committed to cultivating an inclusive work environment for all employees to positively impact our culture every day.

Responsibilities

Architect and Implement AI Systems: design and build scalable, reliable architectures that meet high-performance requirements for AI systems including engine, API... Apply deep knowledge of distributed systems principles to create robust solutions.

Debug and Optimize Across the Stack: dive deep into existing components to identify and resolve issues quickly. Ensure fast turnaround for critical fixes while maintaining system integrity.

Collaborate Across Teams and Partners: work closely with multiple internal teams and external partners to solve complex problems, align on technical decisions, and deliver integrated solutions.

Innovate and Drive Technical Excellence: identify non-obvious technical approaches that unlock new possibilities. Architect and execute features with measurable goals, iterating rapidly to achieve outcomes.

Full-Stack Ownership: engage with components across the entire stack—from infrastructure to APIs—to deliver end-to-end solutions.

Leadership and Influence: Articulate complex concepts clearly, build consensus, and create systems that accelerate team velocity. Demonstrate exceptional judgment and autonomy in execution.

Qualifications

Required Qualifications

• Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience.
• 5+ years of hands-on experience with designing, building, and maintaining distributed systems with scalable architecture, and API designs.
• 2+ years of experience AI/ML fundamentals and practical applications, architecting and delivering AI-based solutions.
• 4+ years of experience with relevant tools and frameworks such as Kubernetes, Azure Devops, or Docker.

Other Requirements

• Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings:
  • • Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter. 

• Master's Degree in Computer Science or related technical field AND 12+ years technical engineering experience with coding in languages including, but not