Senior Data Engineer

<h3>Company Description</h3><p>Natixis in Portugal is a Centre of Expertise whose mission is to transform traditional banking by developing innovative solutions for the business, operations and work culture of Groupe BPCE worldwide.</p><p>Natixis in Portugal is part of the Global Financial Services division, where it applies technology for the development of financial expertise in its two global business lines – Corporate &amp; Investment Banking and Asset &amp; Wealth Management – and, transversally, for the entities of Groupe BPCE.</p><p>The Centre of Expertise, based in Porto, currently has more than 2,400 employees from over 30 nationalities, organised in three main departments: Information Technology, Banking Support Activities and Compliance. These teams work in an integrated, inclusive and transversal way, supporting and creating value for all the business lines and platforms of the group. The project in Porto is one of the biggest investments in Human Resources ever made by Groupe BPCE worldwide.</p><p>A disruptive mindset and a culture of proximity and agility identify Natixis in Portugal Team and reflect the company's mission to transform traditional banking at a global scale: a perfect match in the Portuguese dynamics and entrepreneurial ecosystem.</p><p>In 2024, Top Employers Institute has awarded Natixis in Portugal the Top Employer Portugal accreditation for the second time. This certification recognizes excellence in people practices, following the example of our head office, in France, who was certified Top Employer France for the eight year in a row.</p><h3>Job Description</h3><p> </p><p>We are looking for a <strong>Senior Data Engineer </strong>to join the IT Payments Data Team. The project is being developed by a team that is present in Paris and Porto and is mainly responsible for the evolution and support of the product. Designing, developing, and implementing scalable and efficient data solutions for the payments domain.</p><p><strong><u>Main tasks:</u></strong></p><ul><li>Participate as a technical referent in developing code for processing and analyzing large amounts of data (e.g. unstructured tracking data, large full-text data sets, graph data, etc.).</li><li>Design and implement highly scalable batch or real-time data processing workflows/components and products that make smart use of data to provide data-driven functionality (e.g. search services, recommender services, classification services, etc.), leveraging machine learning, Big Data technology, and distributed systems.</li><li>Build, monitor and operate services delivery within the Natixis infrastructure, while enhancing data quality/utility and automating processes.</li><li>Deploy solutions on cloud technologies, mainly GCP (Google Cloud Platform)</li><li>Work in a cross-functional team and collaborate closely with Data Scientists and Analysts to support the (technical) design, implementation and evaluation of new algorithms, machine learning models and other data-driven features and services.</li><li>Guide and support team members through technical issues and challenges related to data engineering and the uses tech stack.</li></ul><h3>Qualifications</h3><ul><li>Degree in Information Technology or Computer Engineering, Computer Science or a related field.</li><li>Between 3 to 9 years of experience in designing and implementing scalable software and data-driven services using Big Data technologies, data storages (e.g. relational databases, key-value stores), data warehouses, data lakes, data lakehouses and related data processing technologies, as well as programming languages such as Spark / Python / Java / Scala (for real-time and batch processing).</li><li>Experience in building and optimizing data pipelines that process large datasets using Spark and cloud computing environment.</li><li>Experience with working on cloud environments especially with data related services, for example BigQuery, BigTable, Dataproc, GCS, Composer, GKE on Google Cloud Platform and low-code/no-code (e.g YAML) approaches for ETL tools.</li><li>Experience in Business Intelligence and SQL utilization on analyzing large datasets.</li><li>Experience with workflow management platforms (like Airflow) and collaborative platforms (like Jupyter)</li><li>Some experience in the domain of information retrieval, information extraction or machine learning/AI concepts and technologies is a plus.</li><li>Good knowledge of Agile methodologies (SAFe / Scrum).</li><li>In-depth understanding of software development processes, CI/CD methodologies, Devops overview and quality assurance practices.  (e.g. XLRelease/XLDeploy, Terraform, Jenkins, GIT, Bitbucket, etc)</li><li>Microsoft Azure and PowerBI is a plus.</li><li>Familiarity with AI concepts and technologies is a plus but not a primary focus of the role.</li></ul><h3>Additional Information</h3><p><strong>#MuchMoreThanJustAJob</strong></p><p>Early morning. Campo 24 de Agosto. In <strong>4 minutes, you are clocking