Senior/Staff Data Engineer

In a world where trades are happening faster than ever to answer our needs, where sustainability is not just an option anymore, clarity and trust in the information we trade with are a must. <br/>So, say hello to Kpler! We exist to facilitate sustainable and efficient trade to meet the changing needs of our world. To do so we've built a Data-as-a-Service solution that does exactly that across the lifecycle of a trade.<br/>Our solution aggregates data from hundreds of sources including radar and satellite imagery as well as logistics, governmental, shipping databases and more. Intelligently connecting the dots across fragmented information landscapes, we bring to our clients a unique, real-time understanding of the trades happening all over the world, by giving them access to live information about the movement of cargos, the availability of vessels as well as commodity storage.<br/>To support this endeavor, we have teams in more than 7 countries and 9 key locations (Brussels, Paris, Hyères, London, Vienna, Dubai, Singapore, Houston and New York). With individuals of various backgrounds, diverse skills, and international experiences, being global &amp; inclusive is in our DNA!<br/><br/>We are looking for a Senior Data Engineer to join our software engineering team (over 100 engineers). <br/>Some of the exciting projects you could work on include: • Building a new pipeline to feed a live database which is used by clients and research teams to produce useful insight on the commodity market• Building new features for our core platform including metrics &amp; forecasting as well as scaling and stabilizing our data pipelines<br/>As a Senior Data Engineer, you will: • Find efficient ways to tackle challenges using the relevant and up to date technologies• Work across the stack to deliver new features from start-to-finish• Improve performance and overcome scalability limits• Own meaningful parts of our service, have an impact, grow with the company• Actively share knowledge and document insights to support continuous team improvement and collaboration• Act as a mentor for our junior engineers; On some projects, you may also need to act as the Tech lead <br/>Our Tech stack includes:• VueJs, D3js, RESTfulAPI and more on the frontend• Python, Java, Scala, Postgresql, ElasticSearch, Kafka, Spark, Snowflake and more on the backend• AWS, GCP, terraform and ansible for DevOps tools<br/>You may be a fit if...• You have at least 10 years of experience in a similar role including significant experience in Python, Java, Scala or equivalent language• You have over 5 years experience working with AWS and cloud technologies• You have experience in radar image processing• You have used the Java libraries of the ESA SNAP toolboxes• You are familiar with orchestration and in particular Astronomer• You are familiar with building ETL and data pipelines, using asynchronous framework is a plus• You are comfortable with SQL and NoSQL databases for OLTP and OLAP usages• You value code simplicity, performance and details• You have demonstrated that you can learn and adapt quickly • You are fluent in English and have experience working in an international environmentWhat you will receive from Kpler:• You’ll get to work in a truly global work environment, with offices in 7 countries (UK, France, Belgium, Austria, US, Dubai and Singapore), we come from more than 50 countries and speak more than 20 languages• We have truly embraced the new age of workplace flexibility where you can chose to work hybrid or onsite• We offer <a href="https://www.notion.so/kpler/Benefits-at-Kpler-e9df1b27bb3947f6889037be283996b2">competitive compensation &amp; benefits</a> including work from home allowance, medical and life insurance, training and development allowance, paid volunteer work and more!• You will receive a company laptop and you can choose between Windows, Mac, or Linux• Global maternity (extended leave), parental, festival and compassionate leave policies aligned to the contemporary needs of the family, and individual choices<br/>And you REALLY want to join our Engineering team because:• Interesting product &amp; challenging technical problems to solve: our market is very specialized and quite complex! This means we build real algos and there’s some serious software engineering at work here!• Our growth is exponential: we build new features and products everyday! We frequently tackle brand-new business areas which means there’s always everything to build and always an interesting problem to sink your teeth into!• We are at the cross-road of Software Engineering, Commodity, Energy and Finance. This creates an interesting cultural mix: We value the flexibility, collaboration and employee-centric approach that the Tech culture brings but we also value the pragmatism, hard-working and intellectual excellence expectation that often runs in the Finance and Energy worlds• Team of 85+ talented Engineers working with the most modern tech stack<br/>Recruitme