Senior Data Engineer – Critical Environment Systems Intelligence

Are you passionate about cloud computing? Would taking a hands-on approach to transforming Microsoft’s most critical business through investigation, data analysis, and automation be exciting to you? If so, come and help us build the most reliable & efficient datacenter infrastructure on the planet. The Cloud Operations + Innovation (CO+I) Critical Environment Systems Intelligence (CESI) team is responsible for designing and delivering solutions to support global datacenter operations and to improve availability. CESI is helping to drive CO+I’s transition to a customer centric, data driven, live service culture. As our newest Senior Data Engineer, you will be a key player in this transition.

You will be responsible for aggregating live and historical telemetry that are used to create and maintain critical environments to enable scenarios like Customer Impact Radius and Anomaly detections. You will partner with CO+I teams to build off and leverage each other to ensure that we are driving continuous improvements across the fleet for critical environment anomaly detections and detection onboarding. You will work with massive amounts of data with low latency requirements across cutting edge technologies, with the potential for significant potential impact to both internal partners and external customers. We are a customer first, outcome focused, and data driven team in alignment with Microsoft values. We are committed to cultivating an inclusive work environment for all employees to positively impact our culture every day.

Cloud Operations + Innovation (CO+I) is the engine that powers Microsoft’s core cloud platforms and services that millions of people use every day. With more than 95% of Fortune 500 business on Azure, 180 million using Office 365, and millions using other services – all running on Microsoft's cloud infrastructure – CO+I builds and operates the foundation upon which Microsoft’s mission to empower every person and organization comes to life.   

Microsoft is on a mission to empower every person and every organization on the planet to achieve more. Our culture is centered on embracing a growth mindset, a theme of inspiring excellence, and encouraging teams and leaders to bring their best each day. In doing so, we create life-changing innovations that impact billions of lives around the world. You can help us achieve our mission.  

Responsibilities

• Create innovative data driven solutions to complex and unconventional problems related to our DC Critical Environments.
• Drive to the development and design of data services and pipelines that are highly available, scalable, and reliable to meet the needs of the business. (i.e. Typically working with Billions of records per day)
• Leads discussions and creates proposals for the data architecture of products/solutions by testing design hypotheses and helping to refine code plans
• Leads by example within the team by producing extensible and maintainable code
• Optimizes, debugs, refactors, and reuses code to improve performance and maintainability, effectiveness, and return on investment (ROI)
• Applies metrics to drive the quality and stability of code, as well as appropriate coding patterns and best practices
• Design and implement monitoring and alerting solutions to ensure the health of our critical production data environments
• Collaborate with software development and data engineering teams to ensure that software systems are designed with security, privacy, and reliability in mind
• Participate in incident response to identify and address root causes of issues (DRI)

Qualifications

Required Qualifications:

• Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 3+ years experience in business analytics, data science, software development, data modeling, or data engineering
  • OR Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 4+ years experience in business analytics, data science, software development, data modeling, or data engineering
  • OR equivalent experience.
• 4+ years of experience as a Database Engineer or similar role
• 4+ years hands-on experience with Azure Synapse Analytics, Azure Log Analytics, and/or any analytical and visualization tools (PowerBI, Grafana, Dynamics 365, etc).