Data Engineer Senior Manager

We are seeking a highly skilled Senior Data Architect / Data Engineer to join our data team and drive the development, maintenance, and optimization of our Azure-based data platform. This role will focus on leveraging Azure Synapse Analytics, Azure Data Lake, and Apache Spark to build scalable, secure, and high-performance data solutions. The ideal candidate will have deep expertise in data architecture, data engineering, data modeling, SQL and multiple programming languages (e.g., Python, Scala etc.) along with a strong background in Dev Op’s and a proven ability to lead complex data initiatives. 

ESSENTIAL JOB FUNCTIONS: 

• Data Pipeline Development: Build and maintain efficient, secure, and reliable ELT pipelines using Azure Synapse Analytics and Apache Spark. 

• Data Modeling and Warehousing: Develop and optimize data models (e.g., star schemas, snowflake schemas) for data warehousing and analytics, ensuring performance, scalability, and maintainability within Azure Synapse analytics. 

• Data Governance and Security: Implement data governance frameworks, including data quality, lineage, and cataloging, using Azure Purview or similar tools. Ensure compliance with security standards and data privacy regulations (e.g., GDPR, CCPA). 

• Dev Ops: Take ownership of existing Azure Dev Ops pipelines, source code repositories and branching strategies and produce new artefacts when required. Be responsible for managing all Azure EDW resources using infrastructure as code tooling. 

• Performance Tuning: Monitor and optimize the performance of Azure Synapse Analytics, Data Lake, Spark jobs and on-premise SQL Servers including query optimization, partitioning, and indexing strategies. 

• Integration and Collaboration: Collaborate with cross-functional teams (e.g., business analysts, report and application developers) to integrate Azure data solutions with other systems, including APIs, third-party tools, and business applications. Provide guidance and mentorship for other less experienced team members. 

• Innovation and Strategy: Stay abreast of emerging Azure data technologies, Apache Spark advancements, and industry trends, recommending and implementing innovative solutions to enhance the data platform. 

QUALIFICATIONS 

• Bachelor's degree in computer science, Data Science, Information Technology, or a related field (or equivalent work experience). 

• 7+ years of experience in data architecture, data engineering, or related roles, with at least 3 years focused on Azure cloud platforms. 

• Extensive hands-on experience with Azure Synapse Analytics, Azure Data Lake (Gen2), SQL Server and Apache Spark. 

• Proven track record of designing and implementing large-scale data solutions in a cloud environment. 

• Strong background in Dev Op’s culture with a deep understanding of source control and infrastructure as code. 

• Microsoft certifications in Azure data technologies (e.g., Microsoft Certified: Azure Data Engineer Associate, Azure Solutions Architect Expert). 

• Familiarity with Power BI o