Senior Software Engineer - CoreAI

APIs are the backbone of our connected digital world. The AI Gateway Team  is hiring a Senior Software Engineer - CoreAI as a part of the Developer Division at CoreAI; offering a comprehensive solution for managing the full API lifecycle—securing, governing, and controlling AI Tools. The platform empowers thousands of developers globally to build and manage Agentic, Web, Mobile, Event-Driven, and IoT applications. It also underpins key Microsoft services like Azure AI Foundry, Consumer Copilot, Logic Apps, Copilot Studio, Power Platform, Bing, and more—enabling rich developer and consumer experiences.   

Bringing simplicity to customers creates challenging engineering opportunities in areas like scalability, high-density, multi-tenancy, high availability, user experience, and developer tools.   

The rise of generative AI opens new frontiers—join the AI Gateway Team to help shape the future of AI developer and application workloads.  

We’re looking for an engineer who is passionate about building new products in a fast-paced AI-driven world while managing a globally distributed service. The ideal candidate delivers high-quality solutions independently and thrives in a collaborative, diverse team. Versatility, quick learning, and adaptability are essential. 

In this role, you’ll design and deliver the next generation of services, features, and developer tools that shape how AI applications are built and operated. You’ll work across open-source and platform components in multiple programming languages. This is a unique opportunity to contribute to large-scale distributed systems and drive initiatives central to Microsoft’s Core AI strategy.  

Key Responsibilities:  

• Lead System Design & Architecture: Drive architecture discussions, author design documents, and ensure systems meet security, compliance, and scalability requirements while balancing long-term sustainability with short-term delivery.
• Deliver High-Quality Code: Write extensible, maintainable, and performant code; debug and optimize complex systems; and uphold engineering standards through rigorous code reviews.
• Drive Implementation & Deployment: Lead project planning and experimentation, validate the impact of changes, and ensure safe, reliable deployments across distributed environments.
• Ensure Reliability & Operational Excellence: Maintain live site health, develop incident response playbooks, lead root cause analyses (RCAs), and implement systemic improvements to reduce incident volume and improve SLAs.
• Advance Engineering Tools & Practices: Identify and build developer tools, apply automation in production workflows, and stay current with emerging technologies and industry trends.
• Shape Product Strategy: Influence the product roadmap by aligning technical direction with business goals, leveraging customer feedback, data insights, and competitive analysis.
• Foster Cross-Team Alignment: Collaborate with partner teams to deliver cohesive end-to-end experiences and ensure shared ownership of technical direction.
• Build Core Capabilities: Design and develop foundational platform components and reusable building blocks that accelerate innovation and team velocity.
• Other: Embody our culture and

  Apply for this role

  Generate a tailored application kit with a matched cover letter, interview prep, and CV highlights — in under 60 seconds.

  Apply Now →Generate Application Kit

  Free account required — sign up in 30s

  Report an issue

  Company

  Microsoft

  View company profile →