Data Engineer Associate - Data Platform Services

About this role

About Data Ops Engineering (DOE)

Data is at the heart of Aladdin and increasingly the ability to consume, store, analyse and gain insight from data has become a key component of our competitive advantage. The DOE team is responsible for the data ecosystem within BlackRock. Our goal is to build and maintain a leading-edge data platform that provides highly available, consistent data of the highest quality for all users of the platform, notably investors, operations teams, and data scientists. We focus on evolving our platform to deliver exponential scale to the firm, powering the future growth of Aladdin data.

About this role

As a data engineer at BlackRock, you will get experience working at one of the most recognized financial companies in the world while being part of a team responsible for building Enrichment Services for the next generation Enterprise Data platform (EDP), which is designed to automate data acquisition, ingestion, transformation, and distribution processes to handle enterprise-wide data processing capabilities. You will partner with data and analytics experts to deliver high quality data analytical solutions to our consumers.

Candidates are expected to have deep understanding of core ETL components. This role is responsible for embodying engineering best-practices as a habit.   Also responsible for ensuring long-term sustainability and scalability of work.

Data engineers are expected to work in the areas of building frameworks for ETL/ELT use cases and metadata driven data pipeline processing engines with cloud native service expertise. We are looking for candidates who like to innovate and resolve complex data problems.

Responsibilities:

Data engineer is expected to be engaged from inception of projects, understand requirements, design architecture, develop, deploy, and maintain ETL / ELT framework. The goal is to increase the automation of data pipelines, support both internal and external teams to leverage the reusable ETL components and adopt to the standards of modern data platform while constantly working towards enhancing the enabling core ETL framework with new features and improving platform performance and scalability.

• Contribute to the development life cycle and maintain Data Platform enrichment services ETL framework, acquisition framework, workflow orchestration for data pipelines, including participation in tactical projects and strategic programs.
• Generate ideas for designing and building data engineering solutions using standard frameworks.
• Adopt new tools and technologies to enhance the capabilities for the frameworks.
• Work with program managers, product teams and data stewards throughout the SDLC cycle.
• Build and conduct end-to-end tests to ensure production operations run successfully after every release cycle.
• Provide L2 or L3 support for technical and/or operational issues.
• Ability to speak with confidence to individuals, both technical and non-technical, outside the team.
• Ability to demonstrate deep understanding of ETL/ELT core components.
• Ability to design and build ETL solutions which are performant, consistent, and scalable.
• Ability to contribute on design decisions for complex systems.
• Ability to support the ETL framework including all complex components.
• Take responsibility for work beyond assigned tasks. Take emotional ownership of projects.
• Address issues promptly and transparently.
• Take on challenges outside of day-to-day responsibilities.

Required Experience:

• At least 3+ years’ experience as a data engineer
• ETL/ELT Framework design and Workflow Orchestrations
• Experience with object-oriented design patterns
• Experience with ETL Performance Tuning
• Experience in SQL, PL/SQL programming, Stored procedures, UDFs
• Experience in Python programming
• Experience with Agile development concepts and related tools
• Experience conducting root cause analysis and solve issues.
• Excellent written and verbal communication skills.
• Ability to operate in a fast-paced environment.
• Strong interpersonal skills with a can-do attitude under challenging circumstances
• BS equivalent degree

Desired Qualifications:

• Experience with Snowflake, SnowPipe, Snowpark, MS SQLServer
• Exposure with Workflow management tools such as Airflow
• ETL tools like DBT
• Experience in Azure Cloud Native services
• Exposure to real time streaming platforms such as Kafka
• Bachelor’s degree in computer science is preferred.

Our benefits

To help you stay energized, engaged and inspired, we offer