Senior Databricks Engineer (Azure)

<h2 id="job_meta"> <p>Location: Lisbon,None,None </p> </h2> <p><strong>Overview:</strong></p><p>We are looking for a <strong>Senior Databricks Engineer</strong> with deep, hands-on expertise in <strong>Azure Databricks</strong>. While our team has experience with Azure Data Factory (ADF) and pipeline development, we are specifically seeking a senior-level engineer who can take ownership of all <strong>Databricks-related architecture, development, and optimization</strong>.<br/>This role is essential to strengthen our Azure data platform and accelerate the delivery of high-quality, scalable data products into our <strong>Global Data Platform (GDP)</strong>.</p><p><strong>What will you do?</strong></p><ul><li>Take the technical lead in all Databricks-related development and architecture;</li><li>Design and implement scalable, high-performance data pipelines using Databricks notebooks (PySpark);</li><li>Develop reusable frameworks, templates, and best practices for Databricks development;</li><li>Collaborate with data engineers, architects, and analysts to translate business needs into robust Databricks solutions;</li><li>Integrate Databricks with other Azure services such as ADF, Data Lake, and Azure SQL;</li><li>Guide and mentor team members in Databricks usage, performance tuning, and modular development.</li></ul><p><strong>What are we looking for?</strong></p><ul><li>Extensive hands-on experience with Azure Databricks in production environments;</li><li>Strong proficiency in PySpark, SQL, and Delta Lake;</li><li>Deep understanding of Lakehouse architecture, data modeling, and data quality frameworks;</li><li>Familiarity with Collibra for metadata management and data governance integration;</li><li>Experience with CI/CD pipelines using Azure DevOps, Git, and Infrastructure as Code;</li><li>Familiarity with Azure Data Factory, Azure Data Lake, and Azure SQL;</li><li>Ability to coach and support other engineers in Databricks best practices;</li><li>Fluent in English; Dutch is a plus;</li><li>Microsoft certifications such as DP-203 or Databricks Certified Data Engineer;</li><li>Experience with metadata-driven development, data governance, and data mesh principles;</li><li>Background in insurance, finance, or public sector environments is a strong advantage.</li></ul><p><strong>What can you expect from us?</strong></p><ul><li>A permanent job contract for a long term project;</li><li>Tech equipment + SIM Card + personal smartphone;</li><li>Health and Life Insurance;</li><li>Social events and team buildings;</li><li>The commitment of letting you grow with us, and be rewarded accordingly;</li><li>A dynamic and young team that will be always there to support you;</li><li>Training in the latest technologies;</li><li>Coffee, fruits, snacks and a warm welcoming when you pass by the office.</li></ul> <a href="https://caixamagica.recruiterbox.com/jobs/fk0p5nt/?apply=true">Apply to this job</a>