Junior Data Engineer - Databricks

Junior Data Engineer – Databricks

About Citco:

Since the 1940s, Citco has provided specialist financial services to alternative investment funds, investors, multinationals, and private clients worldwide. Our data engineering initiatives represent one of our most critical technical focus areas, driving innovation across our global operations.

About the Role:

As a Junior Data Engineer, you will work on Citco's enterprise‑wide Centralized Data Platform (CDP) built on Databricks, contributing to our data infrastructure, API integrations, and future AI initiatives, while collaborating with data scientists, analysts, and business stakeholders to transform raw financial data into actionable insights; you will build and maintain data pipelines on the Databricks Lakehouse Platform using agile methodologies, develop scalable ETL/ELT processes, implement data quality controls, and ensure data governance standards are met, all within our AWS cloud environment to power critical business operations with the highest standards of data security and compliance.

This role offers the opportunity to work with cutting-edge technologies while solving complex data challenges in a global financial services environment. You'll be part of a team driving technical excellence and innovation within Citco's data engineering practice.

Key Responsibilities:

• Develop Databricks solutions leveraging Lakehouse architecture for enterprise data processing and analytics

• Develop and optimize ETL/ELT pipelines 

• Utilize Delta Live Tables for data ingestion and transformations

• Apply Unity Catalog features and IAM best practices for security governance and access control

• Support infrastructure and resource management using Terraform

• Participate in Agile/Scrum development process and collaborate with team members

• Implement monitoring solutions for pipeline performance and data quality

Required Qualifications:

• 1+ years of experience in data engineering

• Experience with Python and familiarity with Spark programming

• Demonstrable experience in using AI in development

• Experience with AWS or other similar cloud services

• Understanding of data modeling and SQL

• Familiarity with the Databricks platform

• Experience with version control systems (Git)

• Strong problem-solving and analytical skills

• Excellent communication and collaboration abilities

Nice to Have:

• Financial services industry experience

• Proven ability to learn and apply new technology

What Sets You Apart:

• Active interest in emerging technologies and industry trends

• Experience implementing complex data solutions

• Track record of continuous learning and skill development

• Strong technical documentation abilities

• Experience using AI tools to enhance productivity

Technical Environment:

• Primary Platform: Databricks

• Cloud Platform: AWS (S3, Glue, Lambda)

• Languages: Python, SQL

• Tools: Delta Lake, Unity Catalog, Git

• Additional: Real-time processing, API integrations

Our Benefits:

Your well-being is of paramount importance to us, and central to our success. We provide a range of benefits, training and education support, and flexible working arrangements to help you achieve success in your career while balancing personal needs. Ask us about specific benefits in your location. 

We embrace diversity, prioritizing the