Principal Data Engineering Tech Lead

Security represents the most critical priorities for our customers in a world awash in digital threats, regulatory scrutiny, and estate complexity. Microsoft Security aspires to make the world a safer place for all. We want to reshape security and empower every user, customer, and developer with a security cloud that protects them with end to end, simplified solutions. The Microsoft Security organization accelerates Microsoft’s mission and bold ambitions to ensure that our company and industry is securing digital technology platforms, devices, and clouds in our customers’ heterogeneous environments, as well as ensuring the security of our own internal estate. Our culture is centered on embracing a growth mindset, a theme of inspiring excellence, and encouraging teams and leaders to bring their best each day. In doing so, we create life-changing innovations that impact billions of lives around the world.

The Microsoft Identity security team is on a mission to protect our users from account compromise and fraud. Our data science team is at the core of this mission, creating and improving the machine learning based detections that are used to find and block the malicious actors from harming our systems and customers. We are looking for a Principal Data Engineering Tech Lead to join our growing team of data scientists and machine learning engineers. You will contribute to designing the next-gen cloud-based ML and data infrastructure that support a full-stack Data Science team. You will be responsible for creating, maintaining, and optimizing the data sets and data pipelines used by our cross-functional Data Science team. You will also partner with the data scientists and analysts to define business metrics and build dashboards to monitor our protections systems and detections and guide our product planning. Do you love big data and the challenges it entails? Do you like the idea of applying your technical skills to protect millions of Microsoft customers from malicious actors? Do you want be part of team of smart, talented and mission driven people? Then this job is for you!

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

Responsibilities

• Design, develop, maintain, and oversee data infrastructure, data warehouse and back-end services for ML experimentation, investigations, reporting, data collection, and related functions.
• Ensure the quality control of data pipelines and promote best data engineering practices.
• Create and manage reports and dashboards to monitor KPIs, the identity attack ecosystem, and other indicators crucial for understanding the threat landscape and assessing the accuracy and performance of our detections.
• Collaborate with the team to address business inquiries using telemetry data. Effectively communicate key insights and results to stakeholders and leadership. Utilize data storytelling and visualization techniques to recommend product decisions.
• Embody our Culture and Values

Qualifications

Required/Minimum Qualifications:

• Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 6+ years experience in business analytics, data science, software development, data modeling or data engineering work
• • OR Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 4+ year(s) experience in business analytics, data science, software development, or data engineering work
  • OR equivalent experience.
• Experience as tech lead/architect role in data engineering support data science team
• Experience in developing tools and data pipelines using Apache Spark and Python or similar tools.
• Experience in building and optimizing "big data" workflows using modern cloud-based platforms, including ETL, business intelligence pipelines, and data visualization tools like Power BI.

Other Requirements:

• Background Check: Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: 
• Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud