Data Engineer - Level Mid or Senior

LGG Advisors, with offices in Porto, Lisbon, London, and Madrid, provides a multitude of high-added-value consultancy services to financial sector firms globally. Our team provides an array of comprehensive services catering specifically to our client’s unique and evolving circumstances which require creative and careful consideration, decision making, and guidance. 

LGG provides a comprehensive range of services in Digital Transformation. Our expertise spans areas such as Software Development, Data Analytics, AI & Machine Learning, Cloud Computing, and Business Intelligence. We leverage cutting-edge technologies and employ agile methodologies to ensure flexibility and adaptation to the new tools and skillsets the market requires.

As our business continues to grow, we are actively seeking a Data Engineer to offer direct support to the Head of Digital Transformation.

We are looking for a talented and experienced Data Engineer to join our Digital Transformation team. The ideal candidate will be responsible for designing, building and maintaining scalable and efficient data systems. This is an opportunity to contribute significantly to digital transformation projects, working with cutting-edge technologies in a collaborative environment.

RESPONSABILITIES

• Design, build and maintain robust, scalable and efficient data pipelines
  
  
• Develop and optimise databases and data models to support advanced analytics
  
  
• Integrate data from multiple sources, ensuring quality, consistency and security
  
  
• Collaborate with data science, analytics and development teams to understand and meet data needs
  
  
• Implement and manage data platforms in on-premises and cloud environments
  
  
• Monitor and improve the performance of existing data systems
  
  
• Document processes and data structures, ensuring the transferability of knowledge
  

QUALIFICATIONS

• Bachelor's degree in Computer Science, Information Technology, or a related field
  
  
• Knowledge of other Data skills languages and technologies
   
  
• Minimum of 3 to 5 years of experience in data engineering, or a related data field
   
  
• Experience with Agile methodologies (Scrum, Kanban)
   
  
• Familiarity with CI/CD tools
  

REQUIREMENTS

• Degree in Computer Science, Engineering, Mathematics, or related areas
  
  
• Proven experience as a Data Engineer, with solid knowledge of designing and implementing data pipelines
  
  
• Proficiency in programming languages such as Python, Java, Scala, etc.
  
  
• Experience with big data tools and technologies such as Spark, Kafka, Hadoop, etc.
  
  
• Familiarity with SQL and NoSQL databases e.g., Redis, Cassandra, RedShift, SQL Server, BigQuery, etc.
  
  
• Experience with cloud platforms (AWS, Azure, Google Cloud)
  
  
• Knowledge of ETL and data warehousing practices
  
  
• Knowledge of data architecture, big data, data warehouse and data lakehouse
  
  
• Experience with ETL tools such as Airflow, NiFi, DBT and others
  
  
• Ability to work in an agile environment an