Senior Data Engineer

Job Description:

Position Description:

Builds technical infrastructure required for efficient Extraction, Transformation, and Loading (ETL) of data from a wide variety of data sources using Object-Oriented (OO)/objection-function scripts languages such as Python, Java, C++, and Scala. Implements and supports relational database functions using query authoring tool (SQL). Deploys and improves "big data" data pipelines, architectures, and data sets by leveraging big data tools including Hadoop, Spark, Kafka, and Kubernetes. Constructs software processes to support data transformation, data structures, metadata, and dependency/workload management utilizing data pipeline and workload management tools such as Azkaban, Luigi, and Airflow. Identifies and designs internal technical process improvements to enable greater data scalability using AWS cloud services such as EC2, EMR, Snowflake, and Elastic - Search. Manipulates, processes, and extracts value from large, disconnected datasets within relational SQL and NoSQL databases -- Postgres and Cassandra.

Primary Responsibilities:

• Develops and optimizes enterprise data and data-pipeline architecture for cross-functional teams.
• Facilitates data delivery and message queues to support software products and systems by leveraging stream-processes systems such as Storm and Spark-Streaming.
• Confers with data processes or project managers to obtain information on limitations or capabilities for data processing projects.
• Develops software system tests and validation procedures, programs, and documentation.
• Analyzes information to determine, recommend, and plan computer software specifications on major projects and proposes modifications and improvements based on user need.

Education and Experience:

Bachelor's degree (or foreign education equivalent) in Computer Science, Engineering, Information Technology, Information Systems, Mathematics, Physics, or a closely related field and three (3) years of experience as a Senior Data Engineer (or closely related occupation) implementing data solutions in an Online Transaction Processing/Operational Data Store (OLTP/ODS) environment.

Or, alternatively, Master's degree (or foreign education equivalent) in Computer Science, Engineering, Information Technology, Information Systems, Mathematics, Physics, or a closely related field and one (1) year of experience as a Senior Data Engineer (or closely related occupation) implementing data solutions in an Online Transaction Processing/Operational Data Store (OLTP/ODS) environment.

Skills and Knowledge:

Candidate must also possess:

• Demonstrated Expertise (“DE”) designing, developing, and testing highly scaled data models in Continuous Integration and Continuous Deployment (Cl/CD) pipeline using Jenkins, Artifactory, and GitHub.
• DE implementing operational data stores and data lakes in production environments; performing data analysis on multiple database platforms—Snowflake and S3; developing ELT/ETL pipelines to move data to and from Snowflake data store using Python and Snow SQL within Snowflake.
• DE building, deploying, and running secure Cloud-native applications using Azure core services — Identity and Access Management (IAM), ADF, VM, Databricks, and Data Lake.
• DE designing, developing, and testing high-volume, highly available, and fault tolerant real-time data processing, analytics, and reporting for enterprise applications; performing data engineering using SQL queries; and developing secure applications within an Agile Scrum environment.

#PE1M2

#LI-DNI

Certifications:

Category:

Information Technology

Fidelity’s hybrid working model blends the best of both onsite and offsite work experiences. Working onsite is important for our business strategy and our culture. We also value the benefits that working offsite offers associates. Most hybrid roles require associates to work onsite every other week (all business days, M-F) in a Fidelity office.

Please be advised that Fidelity’s business is governed by the provisions of the Securities Exchange Act of 1934, the Investment Advisers Act of 1940, the Investment Company Act of 1940, ERISA, numerous state laws governing securities, investment and retirement-related financial activities and the rules and regulations of numerous self-regulatory organizations, including FINRA, among others. Those laws and regulations may restrict Fidelity from hiring and/or associating with individuals with certain Criminal Histories.