Senior Software Engineer, CoreAI

Joining the CoreAI organization at Microsoft means becoming part of the team that builds the end-to-end AI stack powering Azure’s innovation. As a member of the FIT training team within CoreAI, you will help develop the AI infrastructure that accelerates the creation of agentic AI systems across Microsoft. This role is dedicated to advancing scientific methods and scalable infrastructure for training agentic models to achieve frontier-level performance. You will contribute to LLMs, SLMs, and agentic models using both proprietary and open-source frameworks, all aimed at delivering reliable, enterprise-grade agentic workflows.   

We are seeking a curious, independent, adaptable problem-solver who thrives on continuous learning, embraces changing priorities, and is motivated by creating meaningful impact. Candidates must be able to lead and role models for team that is driven, able to write efficient code, debug complex training jobs, document findings, and demonstrate a track record of continuous improvement. In addition, we value an agile, startup-style mindset - someone who can iterate quickly, pivot when needed, and collaborate effectively in fast-paced, dynamic environments.   

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond. 

In alignment with our Microsoft values, we are committed to cultivating an inclusive work environment for all employees to positively impact our culture every day.   

As a member of our team, you will participate in developing innovative solutions across AI Platform. Responsibilities include the following.    

• Collaboration with engineers and researchers to build and optimize training infrastructure and tools for LLMs, SLMs, multimodal, and code-specific models.   

• Design, build and improve services with high scalability and reliability.   

• Design and implement the services to serve the prod traffic and fulfill the security and privacy requirements.  

• Participate in efforts to deliver and improve engineering systems and practices to ensure service quality in complex cloud environments.  

• Contribute to the deployment and monitoring of services in production environments. 

Required Qualifications:  

• Bachelor's Degree in Computer Science or related technical field and 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, Python, or equivalent experience. 

Other Requirements: 

• 5+ years of software engineering experience, with significant ownership of production services, cloud platforms, distributed systems, or developer infrastructure. 

• Strong experience building and operating containerized platforms using Kubernetes or similar orchestration systems. 

• Strong coding skills in one or more systems or backend languages such as Python, Go, Rust, C++, C#, or Java. 

• Experience designing reliable production APIs, backend services, or control-plane systems that manage compute, storage, networking, or runtime environments. 

• Solid understanding of cloud infrastructure fundamentals, including identity, networking, storage, observability, capacity planning, security, and safe deployment practices. 

• Experience diagnosing production issues using logs, metrics, traces, dashboards, and incident response processes. 

• Demonstrated ability to lead technical design, drive ambiguous projects to completion, mentor other engineers, and collaborate across teams. 

Preferred Qualifications: 

• Experience with Microsoft Azure, AWS, or Google Cloud, especially managed Kubernetes, container registries, object storage, private networking, identity, secrets, and monitoring services. 

• Experience building multi-tenant platforms where reliability, fairness, quota management, isolation, and security are important. <