Senior Data Engineer

<p>At Kantox we are looking for a Senior Data Engineer who will join our Tech team and improve and enhance our current data architecture. Kantox is a growing organisation with growing data needs, therefore scalable, reliable and efficient data architecture and orchestration of data pipelines are fundamental for our business. 🚀</p><p>This is a full-time, exciting job with big responsibilities, as you will be the first dedicated data engineer to work in partnership with our Data Science and Cloud teams. You will be joining a vibrant and passionate group of software engineers that hail from all parts of the world. 🌏</p><h3>The Kantox Engineering Manifesto</h3><p>Kantox is a team sport. Our engineering culture is devoid of egos yet we take great pride in our work. We believe in constructively challenging each other pushing our knowledge, code, processes to the absolute limit.</p><p>Our processes are based around continual self improvement, continuous code integration and deployment.</p><h3>About the team</h3><p>You will work closely with our Data Science and Cloud Engineering teams focussing on the development and management of data pipelines across various domains, delivering data for internal decision making as well as for the visibility of our clients in a scalable and reliable way. Our Data Science team's mission is to build meaningful metrics and models which give deeper insight into the company's activity and performance in various aspects of the business, from commercial to compliance, to operations and customer relationship management. Our Cloud Engineering team builds and manages our cloud infrastructure. It integrates the services that are the backbone of Kantox.</p><p><br/></p><h3>Your future role at Kantox</h3><p>As a Data Engineer you will work in an interdisciplinary team of Data Scientists, Cloud Architects and other data experts. You will help to build a data lake for the collection, manipulation and delivery of data to our internal and external stakeholders. This development will bring great innovation and modernise the way that the data is gathered, processed and consumed. You will be responsible for designing and creating new data pipelines that will hydrate the data lake, with particular focus on the scalability of the processes and the correct governance of the data. This is a great opportunity to join a fast growing company with a highly stimulating role with important growth opportunities, in a very exciting phase of the company's evolution.</p> <h3>What you will do </h3><ul> <li>Work with Data Scientists, Data Analysts and Cloud Engineers to design and define the data lake and the structure of its data in the various stages of data preparation.</li> <li>Contribute in automating, advancing and modernising existing solutions.</li> <li>Build highly scalable and reliable data pipelines using Python, PySpark, SparkSQL.</li> <li>Adopt AWS solutions and services related to data to implement the data infrastructure.</li> <li>Work in the Tech Team following an agile methodology.</li> <li>Familiarise with the business to understand the data needs of different business stakeholders, internal and external, and apply this knowledge to design optimal solutions.</li> <li>Participate in data modelling and data analysis using various tools.</li> <li>Follow data engineering best practices and share knowledge with the rest of the Data and Cloud teams.</li> <li>Be the pioneer Data Engineer at Kantox and build a solid understanding of this role in the company.</li> </ul> <h3>Who you are</h3><ul> <li>5+ years of professional experience as a Data Engineer, you can demonstrate the ability to deliver efficient data solutions in a production environment.</li> <li>Able to handle ingestion of data from different sources (relational databases, NoSQL databases, unstructured data, data streams..)</li> <li>Strong programming skills in Python (knowledge of R is a plus).</li> <li>Experience with Apache Spark (PySpark and Spark SQL).</li> <li>Very good knowledge of AWS Services like Glue, S3, Athena, Redshift, Lambda, and Step functions</li> <li>Testing: you are convinced of its value and you know how to create useful, complete tests.</li> <li>Data savvy individual with knowledge of data preparation for modelling, analysis and data based storytelling.</li> <li>Familiar with agile work and collaboration tools like Jira, Confluence.</li> <li>Familiar with SDLC (Software Development Life Cycle)</li> <li>Able to work in a dynamic environment.</li> <li>A team player, capable of effective communication across multiple teams and stakeholders, both internal and external.</li> <li>True believer of continual improvement.</li> <li>Fluent in English.</li> <li>Permission to work within the EU is a plus.</li> </ul><h3>Our culture</h3><ul> <li>An environment of innovation, accountability, and constructive feedback</li> <li>A diverse and multicultural team of over 40 different nationalities</li> <li>Grow your role and build your