Data Engineer Senior

<p><b>Key Responsibilities: </b></p> <ul> <li> <p>Onboard New Data Sources: Collaborate with business areas to integrate new data sources and use cases. Design and implement scalable data pipelines using Azure Data Factory and Event Hubs </p> </li> </ul> <ul> <li> <p>Implement Security Best Practices: Ensure compliance with enterprise security requirements and implement best practices. </p> </li> </ul> <ul> <li> <p>Technical Support: Provide second-level technical support to users. </p> </li> </ul> <ul> <li> <p>Collaborate with Users: Work with platform users to create scalable, production-grade data processing environments. </p> </li> </ul> <ul> <li> <p>Monitor Platform Health: Oversee platform health, costs, and performance to ensure optimal operation. </p> </li> </ul> <ul> <li> <p>Support Automation: Develop and maintain automation tools for various platform components. </p> </li> </ul> <ul> <li> <p>Data Lake Architecture: Build and manage data lake architecture using Delta Lake and Databricks. </p> </li> </ul> <ul> <li> <p>Data Governance: Implement data governance and security controls to protect data integrity and privacy. </p> </li> </ul> <ul> <li> <p>Reusable Components: Create reusable components and templates for data ingestion and processing. </p> </li> </ul> <p> </p> <p><b>Required Skills: </b></p> <ul> <li> <p>Data Modeling: Strong experience with data modeling and Delta Lake architecture. </p> </li> </ul> <ul> <li> <p>Machine Learning: Knowledge of ML and MLFlow.  </p> </li> </ul> <ul> <li> <p>Programming Skills: Proficiency in SQL, Spark/PySpark and Python.  </p> </li> </ul> <ul> <li> <p>Data Platform Experience: Familiarity with enterprise data platforms, especially Databricks.  </p> </li> </ul> <ul> <li> <p>Event Data Processing: Experience with event data processing. </p> </li> </ul> <ul> <li> <p>Security Knowledge: Understanding of security best practices and compliance requirements. </p> </li> </ul> <ul> <li> <p>Azure Data Services: Expertise in Azure data services like Data Factory and Event Hubs.<br/>  </p> </li> </ul> <p><b>What We Offer: </b></p> <ul> <li> <p>High-impact role in a small, fast-moving team </p> </li> </ul> <ul> <li> <p>Shape the future of industrial data platforms </p> </li> </ul> <ul> <li> <p>Work with cutting-edge cloud technologies </p> </li> </ul> <ul> <li> <p>Flexible remote work policy </p> </li> </ul> <ul> <li> <p>Competitive compensation </p> </li> </ul> <ul> <li> <p>International work environment </p> </li> </ul> <p> </p> <p> </p> <p>Recruitment Team<br/> For questions please contact us via KDcampusporto.recruitment@koerber.com<br/> Please apply exclusively via the “Apply now” button. Recruiter: Vasco Bessa</p> <p>We value diversity and therefore welcome all applicants - regardless of gender, nationality, ethnic or social origin, religion/belief, disability, age, sexual orientation and identity, and any other protected status.</p>