Data Engineer II

With the accelerated growth in cloud computing and increased activity from the recent wave of Generative AI innovations, the Azure Core Insights team is growing to meet this demand. The Azure Core Insights team is hiring a Data Engineer II to join a team of Data Scientists, Data Engineers and Software Engineers working together to improve the quality of Core Azure offerings.

As a Data Engineer II in Azure Core Insights team, you will be working on a broad array of projects and services used to support and advance the quality of Azure Core offerings. Your contributions will help to support one of the largest databases ever built hosting Azure Core service logs, enhance and add to datasets that drive top level Key Performance Indicator (KPI) quality metrics for Azure Virtual Machines, and create new datasets to be leveraged by Machine Learning (ML) algorithms for the purposes of Azure Hardware Failure Prediction and other ML applications. This opportunity will allow you to grow your data skills by working on Azure scale data, provide opportunities to work closely with Data Scientists and expand into Machine Learning work, and position you to influence top executives within Azure via insights derived from data. In addition to the above, our group is rapidly innovating and identifying opportunities to leverage this next wave of Generative AI technologies into our daily work and tooling supporting other groups.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

In alignment with our Microsoft values, we are committed to cultivating an inclusive work environment for all employees to positively impact our culture every day.

Responsibilities

• Implement basic code to extract raw data, validate its quality, and ensure the correct data is ingested within your area of work. Apply basic modification techniques to transform raw data into forms compatible with downstream data sources.
• Contribute to the development of data tools that can transform, manage, and access data. Validate code to test the storage and availability of data platforms.
• Contribute to performance monitoring protocols across a data pipeline, supporting existing visualizations and aggregations to ensure pipeline performance. Assist others in implementing solutions that minimize points of failure and help test improvements across a product feature.
• Follow data modeling and handling procedures to maintain compliance with all applicable laws and policies across your assigned workstreams.
• Learn about permissions and approvals for data access within a data pipeline.

Other

• Embody our Culture and Values

Qualifications

Required Qualifications: 

• Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 2+ years experience in business analytics, data science, data modeling or data engineering work
• OR Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field
  
  • OR equivalent experience.
• 1+ years' experience programming software.
  
• 1+ years' experience working with database query languages.

Other Requirements:

• Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Additional / Preferred Qualifications: 

• Bachelor's Degree in Computer Science , Math, Software Engineering, Computer Engineering,
  
• OR related field AND 5+ years experience in business analytics, data science, software development, data modeling
  
• OR data engineering work
  
• OR Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 3+ years of business analytics, data science, software development, data modeling or data engineering work experience
  
  • OR equivalent experience
    
• 2+ years' experience in Data Engineering.
  
• Exposure to Azure Data Explorer / Kusto Query Language.