Platform Data Engineer | Databricks

Job Description & Summary

PwC is a global leader in professional services and emerging technologies, delivering sustained outcomes for clients through trusted assurance, advisory tax and expertise. As a part of a global network in over 150 countries, we bring together diverse perspectives and deep industry knowledge to solve today’s most important problems with the mindset of tomorrow. We are committed to acting with integrity, fostering a culture where everyone can thrive. Join PwC and part of shaping the future of business. 

About the role 

We are looking for a skilled Platform Engineer with proven hands-on experience in Databricks and a strong understanding of the Microsoft Azure ecosystem. In this role you will build and maintain our Reporting and Analytics Databricks platform to support creation of data flows. 

In collaboration with our team of platform engineers, architects and experts in BI, cloud, and integration to design you will contribute to designing and implementing robust CI/CD workflows and pipelines, standardizing environments and ensuring that the platform is resilient and scalable.  

Ready to help build a data-driven, mature organization? Then apply for this job! 

Key Responsibilities 

• Design and develop metadata-based driven and scalable CI/CD pipelines and workflows within Databricks. 

• Implement Lakeflow declarative pipelines for medallion architecture. 

• Manage Azure components, including Key Vault, Gen2 Storage, and Azure Active Directory. 

• Ingest data from multiple sources via API integration. 

• Deploy jobs and pipelines using Databricks Asset Bundles. 

• Implement unit testing. 

• Manage performance optimization, cluster usage monitoring and system reporting. 

• Manage downstream integrations for reporting (Fabric/PowerBi) and publishing to Databricks Lakebase. 

• Work closely with a multidisciplinary team of data engineers, BI analysts and architects. 

• Willingness to share knowledge with colleagues and contribute to writing documentation for the platform and its usage. 

What we are looking for 

• 5+ years of experience as a Platform Engineer or Data Engineer with focus on the Microsoft Azure ecosystem (e.g. ADLS Gen2, Key Vault, Active Directory). 

• Bachelor's degree in Computer Science, Engineering, or a related field; Master's degree preferred. 

• Proficiency in programming with Python and knowledge of PySpark.