AWS Data Engineer

Ready to build scalable data systems with real-world impact?
 
Join us at FTSE Russell!
We’re establishing a team of engineers passionate about data, software craftsmanship, and substantial impact. You’ll help to power the indices trusted by financial institutions worldwide. You’ll work in an AWS environment, build robust pipelines, and work with product and business teams to deliver reliable, high-quality data solutions.
 
We care strive for code quality, ownership, and helping each other grow. If this resonates with you and building systems that matter, we’d love to meet you!

What you’ll be working on
We are building a next-generation data platform, and we want you to craft it with us. Your role will involve:

• Crafting and developing scalable, testable data processes using Python and Apache Spark

• Working with AWS tools such as Glue, EMR Serverless, Lambda, and S3

• Applying software engineering practices: version control, CI/CD, modular design, and automated testing

• Helping in the development of our Lakehouse using Apache Iceberg

• Collaborating with our business users and translate requirements into data-driven solutions

• Building observability into data flows and implementing basic quality checks

• Participating in code reviews, pair programming, and architecture discussions

• Continuously learning about the financial indices domain and sharing insights with the team

Must Have Tech Skills: 

• Shown previous experience as a data engineer. 

• Technical knowledge of data engineering solutions and practices. Implementation of data pipelines using tools like EMR, AWS Glue, AWS Lambda, AWS Step Functions, API Gateway, Athena

• Proficient in Python and Spark, with a focus on ETL data processing and data engineering practices.

Nice To Have Tech Skills: 

• Familiar with data services in a Lakehouse architecture.

• Familiar with technical design practices, allowing for the creation of scalable, reliable data products that meet both technical and business requirements

• Familiarity with terraform

Key Accountabilities: 

• Writes high quality code, ensuring solutions meet business requirements and technical standards. 

• Works with architects, Product Owners, and Development leads to decompose solutions into Epics, assisting the design and planning of these components. 

• Builds clear, comprehensive documentation that clearly showcases understanding of the implementation and compliance. Experience in decomposing solutions into components (Epics, stories) to streamline development. 

• Actively gives to technical discussions, supporting a culture of continuous learning and innovation. 

Key Skills: 

• Proficient in Python and familiar with a variety of development technologies.  

• Previous experience of implementing data pipelines, including use of ETL tools to streamline data ingestion, transformation, and loading. 

• Solid understanding of AWS services and cloud solutions, particularly as they pertain to data engineering practices. Familiar with AWS solutions including IAM, Step Functions, Glue, Lambda, RDS, SQS, API Gateway, Athena. 

• Proficient in quality assurance practices, including code reviews, automated testing, and standard methodologies for data validation.