Data Engineer (m/f/d)

We are seeking an experienced Data Engineer (m/f/d) to design, build, and optimize data pipelines and infrastructure, ensuring reliable, secure, and high-quality data for PPRE’s platforms. As a key player in PPRE’s Data-Driven Organization, you will transform data through the Data Lakehouse, embed governance standards, and support integration into the Operational Data Store (ODS). In this role, you will collaborate with Data Stewards, Data Solution Architects, Data Analysts, and Product Owners to deliver Data Products and maintain data lifecycle management. With a high degree of autonomy, you will drive innovation and ensure governed, high-quality data for enterprise-wide use. 

 

Key Responsibilities

 

Pipeline & Infrastructure Development

• Independently develops, builds, and optimizes complex data pipelines and infrastructure for reliable ingestion, transformation, and delivery of governed data.
• Connect source systems to the ODS and transform Bronze → Silver layer data according to approved business and technical rules.
• Maintain scalable, secure, and high-performance pipeline components. Leads complex, multi‑domain pipeline design decisions, ensuring architectural alignment across departments and anticipating cross‑platform implications.

 

Implementation of Governance & Quality Standards

• Drives advanced governance standardization, converting governance requirements into scalable, repeatable operational processes across multiple Data Products.
• Leads the implementation of data governance standards, including validation rules, schema checks, format rules, referential integrity checks, and quality thresholds. Proactively identifies quality gaps and driving resolutions.
• Champions innovation in automated DQ frameworks and leads the definition of new quality KPIs and lineage monitoring capabilities across domains.
• Execute and Develop Databricks automated Data Quality gates: ingestion validations, transformation gates, and certification gates.
• Log failures and events for Steward review and support continuous remediation.

 

Collaboration With Cross-Functional Stakeholders

• Influences cross‑departmental decision‑making, advising senior stakeholders on data transformation logic, lineage integrity, and platform strategy.
• Represents Data Engineering in governance committees and contributes to firm‑wide standards evolution.
• Work directly with Data Stewards to understand and implement business rules, transformation logic, and KPI definitions.
• Collaborate with Data Analysts to ensure downstream use cases are supported by accurate, complete, governed data.
• Provide pipeline mapping and technical lineage details for Stewards and Governance Officers.
• Influences cross‑functional teams (Stewards, Architects, Analysts, Business Owners) by providing expert guidance on complex technical design decisions, data transformations, and platform optimization

 

Lineage, Documentation & Metadata

• Owns senior‑level lineage governance, ensuring completeness across complex interconnected pipelines and driving structural improvements across domains.
• Support automated lineage monitoring scripts and ensure pipeline behavior matches documented lineage.
• Maintain metadata integrity across all pipeline layers.

 

Data Quality Monitoring & Remediation Support

• Detect anomalies through Data Quality gates, Support remediation in collaboration with Stewards and Engineers.
• Leads root‑cause analysis and resolution of major, cross‑pipeline data quality issues, acting as a coordinator for Engineers and Stewards and ensuring sustainable structural fixes
• Help maintain Data Quality KPI dashboards and event logs.

 

Operational Excellence & Continuous Improvement

• Drives engineering-wide improvements, promoting best practices, innovation, and automation across the full engineering lifecycle.
• Drives automation of checks and controls to improve efficiency and reduce manual work for Stewards and Analysts.
• Contribute to enhancements to pipeline reliability, performance, and observability.

 

 

Key Requirements

 

Technical Competencies

• Demonstrated ability to define and evolve engineering standards across teams and influence architectural direction
• Senior experience developing an