Senior Data Engineer

Job Title: Senior Data Engineer

Start Date: March 1st, 2024

Duration: 6 months

Location: Amsterdam, Netherlands

Join our client, a prominent player in the chemicals and ingredients industry, as they strengthen their Data Engineering (DE) function. As they implement Data Mesh architecture, one of the consumer- data product team is looking for data engineer experienced with application integration. You will join a team that is responsible for provisioning data to Transportation Management System, the key IT project for Supply Chain in the company.

As a Data Engineer, you will be mainly responsible for:

• Collaborating with cross-functional teams to architect, develop, and maintain robust data pipelines that enable advanced analytics and insights
• Utilizing cloud-based technologies, specifically AWS, for data engineering purposes to support scalable and reliable solutions
• Leveraging the Kafka platform for (near real-time) data ingestion & processing of high-volume data
• Implementing continuous integration and deployment (CI/CD) practices
• Orchestrating data workflows with tools like Glue / Apache Airflow
• Managing and provisioning infrastructure as code (IaC)
• Implementing observability on all data pipelines
• Ensuring low latency, high availability, and maintaining transactional integrity

Requirements

To excel in this Data Engineer role, you should possess:

Hard Skills

• Managing and provisioning infra-as-code (Terraform)
• Proven experience defining, implementing CI/CD
• Proven API Development experience
• Experience with Apache Hadoop Ecosystem (Spark, Kafka, Hive, etc.)
• Programming language - Python, SQL
• Orchestration - Glue Workflows / Airflow
• Clear understanding of building applications with low latency, high availability, transactional integrity, real-time processing (i.e., operational plane)
• Communication - working directly with consumers
• Functional requirement to technical requirement
• 80/20 mentality - knows where to focus time
• Previous experience implementing platform / pipeline logging and monitoring (nice to have - Grafana, Loki, Mimir experience)

Soft Skills

• Willingness to work in a physically present capacity at our office in Amsterdam, with the flexibility to work remotely.
• Fluency in English; Dutch language proficiency is a plus.
• Availability to start 1-03-2024

Apply now!

If you are ready to contribute to this exciting journey, apply now and become a key player in advancing the Data Engineering function of our client.