Senior Software Engineer

Microsoft bets on Artificial Intelligence (AI) as the next growth opportunity for the company. OpenAI, Mistral, and other Large language Model (LLM) driven innovations are happening throughout the industry. Azure AI is focused on building a platform that makes it easy for both first party Microsoft teams and third-party customers to build cutting edge applications on top of these large language models.

The Back Plane team in Azure Machine Learning is looking for a Senior Software Engineer who loves to build scalable, highly available, and secure microservices that run in Kubernetes. The infrastructure team focuses on managing a large fleet of Azure Kubernetes Service (AKS) clusters that represents the control plane for Azure AI.

The team focuses on:

1. Managing Kubernetes Cluster live site and deployments at Scale.
2. Secure Control Plane assets from malicious attacks and unauthorized access using industry standard tools and frameworks.
3. Automate Monitors and critical alerts using best in class observability tools such as: Azure Monitor, Prometheus, Azure Data Explorer, Grafana.
4. Automate CI/CD deployments using YAML builds and releases.
5. Extensive experience with Kubernetes cluster creation, management, and optimization. Hands-on experience with GPU support in Kubernetes.

For the Azure ML platform, we build tools to increase the observability of the applications running in the Kubernetes clusters, improve the speed, security, and reliability of our deployments, secure our supply chain and services, and debug production with ease. We use the best of open source, like Prometheus, Grafana, and NGINX, and build solutions to enable Azure ML to deliver a global service that handles large scale ML training and inferencing workloads.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

Responsibilities

As a Senior Software Engineer on our team, you will drive the design, development, and support of the platform that powers Azure Machine Learning. You’ll work across teams to help make the whole organization successful. Your responsibilities will include the following:

• Extensive experience with Kubernetes cluster creation, management, and optimization.
• Expert level knowledge around security and compliance experience for Kubernetes.
• Extensive experience developing Infrastructure as Code (IaC) and Configuration as Code (CaC) solutions using tools like YAML, Bicep, and Helm.
• Solid understanding of networking in k8s for inter, intra and external pod-to-pod, control and data plane communications.
• Write clean and concise code with unit tests.
• Design, implement, and support new features as well as extend existing systems.
• Investigate live site issues and implement and deploy fixes.
• Participate in an on-call rotation.
• Security Configuration and Compliance: Configure, update, and maintain security tools used for endpoint security, log collection and reporting, vulnerability, and compliance scanning. Hardening and compliance with best practices, benchmarks, and remediate vulnerabilities as reported by security.

Other

Embody our culture and values

Qualifications

Required Qualifications: