Senior Software Engineer

Shape the way the M365 measures and drives the feedback loop for its AI offerings!   

On the Evaluation Platform Team, you’ll have a front-row seat to how AI impacts millions of users. You’ll help steer one of Microsoft’s most important efforts forward, taking our evaluation system to the next level for our builders and partners.   

Our goal is to accelerate learning by making sure all the user journeys of an eval system (fine tuning a model, launching a new feature or experiment, adding metrics, onboarding a new 1P or 3P partner, understanding user feedback, creating query sets, etc.) are supported by friendly, agile, reliable, scalable and well documented tools.   

As a Senior Software Engineer, you will build capabilities that will be driving new capabilities that:  

• Enable builders to be more agile, running more evaluations and faster. 
• Provide a continuous set of tools and evaluation capabilities throughout the development lifecycle. 
• Automate tasks via tools or agents to help us understand our performance better. 

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

• Reviews product code and test code to ensure it meets team standards, contains the correct test coverage, and is appropriate for the product or solution area.
• Brings insight to code reviews to help improve code quality, coaching and providing feedback to develop other engineers' skills.
• Conducts code reviews in a timely fashion that helps accelerate the pace of development on the team.
• Considers diagnosability, reliability, testability, and maintainability when reviewing code, and understands when code is ready to be shared or delivered.
• Applies and reviews for coding patterns, security risks, compliance issues, and best practices in code reviews, providing feedback on code to drive adherence to best practices.
• Uses automated source code analysis tools that are incorporated into the build/development process.
• Leads by example within the team to produce extensible, maintainable, well-tested, secure, and performant code that adheres to design specifications.
• Continuously improves code performance, testability, maintainability, effectiveness, and cost, while learning about and accounting for relevant trade-offs.
• Applies metrics to drive code quality and stability.
• Applies appropriate coding patterns and best practices (e.g., leveraging state-of-the-art generative artificial intelligence [GenAI], approaches to source code organization, naming conventions).
• Identifies and escalates blockers or unknowns during the development process, communicates how they will impact timelines, and identifies strategies and/or opportunities to address them.
• Independently creates a clear test strategy that ensures solution quality, prevents regression from being introduced into existing code.
• Ensures test plans incorporate security testing to validate security invariants (including negative cases).
• Drives adding new tests to cover gaps, deleting or fixing broken tests, and improving the speed, reliability, and defect localization of the test suite.
• Independently builds testable code and considers testability during design for a project/sub-section of a product/solution.
• Understands the different types of tests that can be done on a particular system (e.g., unit tests), maintains up-to-date understanding of testing architectures used both across Microsoft and across the industry, and applies them across the architecture as appropriate.
• Identifies difficult or untestable sections of codes for a project/sub-section of a product/solution for future design or rearchitecture discussions. Leverages artificial intelligence (AI) tools for test automation.

Required Qualifications:

• Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience.

• Master's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experie