Senior Data Engineer

<h3></h3><p>At Clarity AI, we are committed to<strong> bringing social impact to markets</strong>. We are a tech company started in 2017, leveraging AI and machine learning technologies to ensure environmental, social and governance dimensions are the focal point of decision making within financial markets.</p><p>We are now a team of more than 180 highly passionate individuals coming from all over the world. Together, we have established Clarity AI as a leading startup backed by investors and strategic partners such as <strong>SoftBank</strong>, <strong>BlackRock</strong>, and <strong>Deutsche Börse</strong> who believe in us and share our goals. We have plans to continue growing our teams in Spain, Portugal, the UK, and the US this year so if you would like to join us on this rocket ship, keep reading!</p><p>Clarity is looking for a <strong>Senior Data</strong> <strong>Engineer </strong>for the Tech team. If you’re a <strong>Software/Data Engineer, specialized in Data </strong>and enjoy solving complex problems with code, developing and you are not afraid of learning new things, we are looking for you.</p><p>You will be part of the team delivering the different parts of our production-ready product while co-designing and implementing an architecture that can scale up with the product and the company.</p><p>Our <strong>tech stack</strong> is documented here: <a href="https://stackshare.io/clarity-ai/clarity-ai-data" rel="nofollow noreferrer noopener">https://stackshare.io/clarity-ai/clarity-ai-data</a><br/></p><p><strong>Location</strong>: This position can be based within Spain.</p><p><strong>KEY RESPONSIBILITIES:</strong></p><ul> <li>You will help to<strong> build a data platform</strong> to enable other teams to self-service high-quality data while performing data operations to support their day-to-day actions.</li> <li>You will join the <strong>data engineering tea</strong>m which is responsible for <strong>developing models, practises and systems to support the data lifecycle.</strong> </li> <li>You’ll support designing and creating all aspects of our ever-growing set of external and <strong>internal data pipelines, understand the problems, and tie them back to data engineering solutions</strong> </li> <li>You will be responsible of <strong>designing and building our ETL's </strong> </li> <li>You’ll <strong>transform raw data</strong> from different sources (batch and near-real-time) into intuitive <strong>data models,</strong> using a diverse set of tools (such as Spark, Hadoop, Redshift, Kafka, etc.) to <strong>build robust data pipelines of high quality</strong> in a scalable fashion (regarding volume and maintainability).</li> <li>In order to develop feature and product features, you will form part of cross <strong>functional squads </strong>including people of many different teams.</li> <li>Work closely with <strong>Platform</strong>, <strong>Data Science and Backend teams,</strong> as well as product and tech teams.</li> <li>Fix, troubleshoot and solve bugs and issues</li> </ul><p><strong>Requirements</strong></p><p><strong>WHAT WE ARE LOOKING FOR:</strong></p><p>We like engineers who adapt quickly to new challenges and break them down in smaller pieces that a highly productive team will find high-quality solutions for. As an Engineer, you will have a solid technical foundation and a strong focus on growing your development skills.</p><p>They use best practices to ship high-quality code and continue to push their knowledge.<br/></p><ul> <li>You have <strong>more than +5 years</strong> of professional experience as a Software Developer/Data Engineer, and hold a degree in a quantitative field (CS, Engineer, Math, Physics, … ).</li> <li>You have built production data pipelines in the cloud, setting up data-lake and server-less solutions; on top of that, you have hands-on experience with schema design and data modeling.</li> <li>Proven knowledge of <strong>Python(Pandas) is required,</strong> Java/Scala will be a plus</li> <li>You have<strong> strong SQL skills and knowledge and familiarity with other distributed data stores such as Redis, ElasticSearch, Druid, Cassandra, Hbase.</strong> </li> <li>You are comfortable working in containerized cloud developments, and familiar with the integration of public and private APIs.</li> <li>Strong communication skills. The right candidate can thrive in an environment of asynchronous conversation, since a part of the Clarity team will be based remotely. </li> <li>Open to try new technologies and programming languages.</li> <li>Fluency in English</li> </ul><p><em>It will be a plus if you had:</em></p><ul> <li>Experience in SaaS fast growing business would be preferable, although not required.</li> <li>Ideally experience in the financial sector or regulated markets.</li> <li>Familiarity with some other technologies / frameworks( Spring Boot, Jersey, Play..) is a plus</li> </ul><p><strong>Benefits</strong></p><p>WHAT WE OFFER:</p><p>Our people are our main asset.