Senior Data Engineer - CoreAI

CoreAI is Microsoft’s central organization building the foundational platforms and tools to power AI experiences across products including GitHub Copilot, Azure AI Foundry, and Copilot Studio. The organization is expanding rapidly and is establishing a world-class data engineering platform to deliver analytical insights to the company leadership and product owners.  

As a Senior Data Engineer - CoreAI, your work will be at the heart of transforming data into actionable intelligence and fueling AI-driven innovation. This highly visible role places you as both a technical leader and a visionary collaborator, where your architectural insight and hands-on expertise will enable product teams to turn complex datasets into breakthrough business value. 

The ideal candidate will thrive in an accelerated culture, demonstrating the ability to adapt quickly to changing priorities while delivering measurable results that propel forward data-driven analytical initiatives. 

We do not just value differences or different perspectives. We actively seek them out and invite them in so we can tap into the collective power of everyone in the company. As a result, our customers are better served. 

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees, we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day, we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond. 

In alignment with our Microsoft values, we are committed to cultivating an inclusive work environment for all employees to positively impact our culture every day. 

Responsibilities

• Data Architecture & Engineering: design, build, and optimize large-scale, robust data pipelines and architectures.
• Data Governance & Trust: follow best practices for data quality, lineage, security, and compliance.
• Analytics Enablement: partner with data scientists, analysts, and business leaders to translate business needs into technical solutions.
• Cross-Functional Collaboration: work closely with product managers, software engineers, AI researchers, and business stakeholders to align data solutions with business goals.

Qualifications

Required/Minimum Qualifications:  

• Master's Degree in Computer Science, Statistics, Econometrics, Electrical, or Computer Engineering, or related field AND 3+ years experience in analytics, software development, large data processing
  • OR Bachelor's Degree in Computer Science, Statistics, Econometrics, Electrical, or Computer Engineering, or related field AND 4+ years experience in analytics, software development, large data processing
    • OR equivalent experience.
• 3+ years of experience implementing and optimizing data pipelines and distributed data systems (e.g., Azure Data Lake, Spark, Synapse, SQL databases) 
• 3+ years of experience with modern data engineering languages and frameworks (e.g., PySpark, SQL, dbt)

Other Requirements: 

Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings: 

• Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter. 

Preferred/Additional Qualifications: