Principal Software Engineer (Microsoft AI Big Data Platform)

Within Bing Fundamentals, Bing MagneTar team provides a range of products that enable software engineers and data scientists to lead the transformation of analytics in the world of data. Our mission is to build a big data platform for the age of AI, using open-source technologies such as Hadoop, Spark, Kafka, Flink and Kubernetes to empower the Microsoft AI organization.

We are hiring a Principal Software Engineer (Microsoft AI Big Data Platform) and are looking to push the boundaries of what is possible, again. You can help rebuild the way analytics engines process data. We build services that enable big data developers to build mission critical applications with high levels of Service Level Agreement (SLA). As an engineer in our team, you will work on and extend Open-Source Software (OSS) technologies like Apache Hadoop, Spark, Delta Lake, Kubernetes as well as proprietary Microsoft services. You will help design & implement software components, participate in code reviews, design reviews, assist customers as needed to be able to leverage the service and keep the service running. You will support a team of talented engineers aiming to improve the abilities of what is possible today with industry leading performance, integration, security and reliability. This will require exploring the frontiers of what is possible.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

Responsibilities

• Design and develop large-scale distributed software services and solutions following modern software engineering practices through design and code reviews.
• Collaborate with appropriate stakeholders to determine user requirements for a scenario, drive identification of dependencies and the development of design documents for a product, application, service, or platform.
• Perform system design with well-defined interfaces across multiple components, leveraging data/telemetry to inform decisions.
• Develop best-in-class engineering for our services, ensuring components are modular, secure, reliable, testable, diagnosable, maintainable, actively monitored, and reusable.
• Improve test coverage, organize and implement integration tests, and resolve problem areas.
• Troubleshoot and optimize automation, reliability, and monitoring for Live Site.
• Embody our culture and values.

Qualifications

Required Qualifications:

• Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • OR equivalent experience.
• 4+ years of hands-on engineering experience developing large-scale distributed systems.
• 2+ years of experience as Senior/Principal technical lead role.
• 2+ years of experience with Big Data technologies like Apache Spark, Hadoop, and Kubernetes.

Other Requirements:

Ability to meet Microsoft, customer and/or government security screening requirements that are required for this role. These requirements include, but are not limited to the following specialized security screenings:

• Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter.

Preferred Qualifications:

• Experience in large scale system architecture, design, development, testing, and release, including but not limited to web applications, microservices in layers, database design, API design, performance tuning, telemetry design and analysis.<