Data Engineer

At Uni Systems, we are working towards turning digital visions into reality. We are continuously growing and we are looking for a Data Engineer to join our UniQue team.

What will you be bringing to the team?

• Design, implement, and maintain scalable data pipelines sourcing data from REST APIs using Python, PySpark, SQL, and ETL tools such as Azure Synapse for data ingestion, transformation, and preparation.
• Process and convert complex JSON and GIS data into structured, analysis-ready datasets by parsing, transforming, and validating content to ensure high data quality and consistency.
• Manage the loading and organization of processed data into Azure Data Lake Storage, ensuring optimal accessibility and performance.
• Create and maintain comprehensive documentation for ETL processes, including metadata definitions, data lineage, and technical specifications to support transparency and future reusability.
• Collaborate closely with data analysts, BI developers, and business stakeholders to gather data requirements and deliver reliable, well-documented datasets tailored to organizational objectives.
• Integrate data quality controls, logging mechanisms, and monitoring features within pipelines to ensure maintainability and effective troubleshooting.

Requirements

What do you need to succeed in this position?

• Bachelor Degree with minimum 17 years of general IT experience (or Master Degree with minimum 13 years of experience).
• Minimum of 5 years of proven expertise with Azure Data Lake Storage and Oracle databases.
• At least 5 years of hands-on experience in developing data pipelines from REST APIs and integrating data using PySpark, Python, Azure Synapse, and SQL.
• Strong proficiency in processing JSON and GIS data, with a minimum of 5 years of relevant experience.
• Excellent command of data engineering tools, including Python, PySpark, and Azure Synapse Analytics.
• Ability to design and implement robust data quality checks, logging, and monitoring mechanisms within ETL workflows.
• Strong skills in documenting ETL workflows, metadata definitions, and technical specifications in a clear and consistent manner.
• Familiarity with DevOps principles and version control best practices; experience working with CI/CD pipelines.
• Prior experience working within Agile and Scrum methodologies.
• Microsoft Azure Data Engineer Associate Certification is required.
• Microsoft Certified: Azure Solutions Architect Expert, Azure Developer Associate, Azure Database Administrator Associate will be an advantage.
• An excellent command of the English language, corresponding to at least level C1 (French will be an advantage).