Senior Data Engineer

Data Engineering Team @HeetchOur millions of rides create an incredibly rich dataset that needs to be transformed, exposed and analysed in order to improve our multiple products. By joining the Data Engineering team, you will be part of a team that impacts the whole business by building the data transport, collection and storage at Heetch<br/>Our team's values• Move smart: We are data driven, and employ tools and best practices to ship code quickly and safely (continuous integration, code review, automated testing, etc)• Distribute knowledge: We want to scale our engineering team to a point where our contributions do not stop at the company code base. We believe in the Open Source culture and communication with the outside world• Leave code better than you found it: Because we constantly raise the bar• Unity makes strength: Moving people from A to B is not as easy as it sounds but, we always keep calm and support each other• Always improve: We value personal progress and want you to look back proudly on what you’ve done<br/><br/>What will be your role?You will own Heetch's data platform by architecting, building, and launching highly scalable infrastructure and reliable data pipelines that'll support our growing data processing and analytics needs. You will also create the tooling that allows users to be self-sufficient, building their own pipelines and data processing. Your efforts will allow accessibility to incredible rich insights enlightening Data Analysts, Data Scientists, Operations managers, Product Managers and many others<br/><br/>Does it sound like you?• At least 3+ years in Software Engineering with a focus on Data Engineering• Extensive experience with Spark or other cluster-computing frameworks• Strong skills in Python + Scala or Java• Advanced SQL query competencies (queries, SQL Engine, advanced performance tuning)• Experience with Kafka in production• Experience with workflow management tools (Airflow, Oozie, Azkaban, Luigi)• Comfortable working directly with data analytics to bridge business requirements with data engineering• Inventive and self-started<br/><br/>Bonus• Experience designing and developing data warehouses• Experience with data engineering in an AWS or cloud environment• Performance tuning and administration of Spark, Kafka, Hive and Redshift• Experience working with Dataiku • Experience working with Kubernetes • Experience deploying and managing AWS infrastructure• Experience building data models for normalizing/standardizing varied datasets for machine learning/deep learning• Experience working on a remote team• Experience developing data engineering tools<br/><br/>What will you do?• Implement and be responsible for a scalable data processing infrastructure which will evolve to based on business and engineering needs• Build large-scale batch data pipelines• Build large-scale real-time data pipelines• Build and monitor ETL • Be responsible for scaling up data processing flow to meet the rapid data growth at Heetch• Consistently improve and evolve data model &amp; data schema based on business and engineering needs• Implement systems tracking data quality and consistency• Develop tools supporting self-service data pipeline management (ETL)• Tune jobs to improve data processing performance• Implement data and machine learning algorithms (A/B testing, Sessionization)• Work with the business, product and engineering teams to create and implement a holistic data architecture•Be involved in tech support 1 week per month from 8 am to 7 pm on weekends (compensated financially). 🌈Heetch embraces diversity and equal opportunity for everyone 🌍 We provide a safe and inclusive work environment. We are committed to building a team that represents a variety of backgrounds, perspectives, and skills. For non-European citizens, a valid working visa for France is required to be eligible for the role.<br/>Heetch SAS is collecting your personal data (identity, contact details, academic background, professional experience and optionally a covering letter) for the processing of your application to our job offer, based on your consent.Your personal data will only be accessible to our hiring team, our co-founders, and the manager of the position you are applying to. In addition, data are stored by our processor in order to use its applications tracking system. Your data may be stored outside of the EU/EEA but are protected by appropriated safeguards.Your data are stored for a maximum duration of two years. If we do not reply to your application, you allow us to store your data during this term in order to potentially contact you for another position within our company or affiliates and subsidiaries.You have a right to access to your data, to rectify them, under some conditions to erase them, and to limit the processing. Also, you have a right of portability on your data. In addition, you may revoke your consent and we shall stop processing your data. Eventually, you have a right to define directiv