Lead, Data Engineer

Company Description

Adtalem Global Education is a national leader in post-secondary education and leading provider of professional talent to the healthcare industry. Adtalem educates and empowers students with the knowledge and skills to become leaders in their communities and make a lasting impact on public health, well-being and beyond. Through equitable access to education, environments that nurture student success, and a focus on expanding and diversifying the talent pipeline in healthcare, Adtalem is building a brighter future for communities and the world.

Adtalem is the parent organization of American University of the Caribbean School of Medicine, Chamberlain University, Ross University School of Medicine, Ross University School of Veterinary Medicine and Walden University.

In our U.S. locations, we operate on a hybrid work model with a four-day in-office schedule, Monday–Thursday. This in-office time fosters creativity, innovation, communication, and stronger team relationships, supporting both individual and organizational success.

Visit Adtalem.com for more information, and follow on Twitter and LinkedIn.
 

Job Description

Adtalem is a data driven organization. The Data Engineering team builds data solutions that powers strategic and tactical business decisions and supports the Analytics and Artificial Intelligence operations. By implementing the data platform, data pipelines and data governance policies this team provides the basis for decision-making in Adtalem. Adtalem is looking for a Lead Data Engineer who is a technical powerhouse who can scale our data platform to meet ever growing business needs.

Responsibilities

• Collaborate with various business, IT, Analytics and Data Science groups to lead business requirement discussion and translate them into scalable, high performance data solutions

• Design for all things Data Platform, from data modeling to data ingestion pipelines, transformation processes, the storage optimization, delivery, and discoverability of high quality datasets

• Collaborate in producing data platform architecture, development standards and best practices, documenting and socializing with wider group in Data Engineering

• Develop data ingestion processes using available tools and technologies, complex SQLs/programs to transform to target data model, build test plan, execute testing and deploy across environments

• Optimize data and processing pipelines for scalability, reliability and fault-tolerance by using data volume, velocity and variety metrics

• Make decisions in complex and multi-faceted data engineering situations requiring understanding of software package options and programming language and compliance requirements that influence and lead Technology to meet deliverables and drive organizational change

• Design CI/CD pipelines to ensure continuous deployment and delivery of our data products.

• Ensure quality of critical data elements, prepare data quality remediation plans and collaborate with business and system owners to fix the quality issues at its root.

• Create design documents, Source to Target Mapping documents and any supporting documents needed for deployment/migration. Capture, store and socialize data lineage and operational metadata

• Ensure that the data pipelines are stable, secure, maintainable and highly available. Support team during troubleshooting & debugging defects & bug fixes, business requests, environment migrations & other ad hoc requests

• Work with business and technology stakeholders to communicate EDW incidents/problems and manage their expectations

• Develop REST APIs to expose data to other teams within the company.

• Mentor and provide technical guidance to junior data engineers promoting knowledge sharing across the team

• Performs other duties as assigned

• Complies with all policies and standards

Qualifications

• Bachelor's Degree Computer Science, Computer Engineering, Software Engineering, or other related technical field.
• Master's Degree Computer Science, Computer Engineering, Software Engineering, or other related technical field.
• 10+ years experience in data engineering solutions such as data platforms, ingestion, data management, or publication/analytics.
• 4+ years experience in Google cloud with services like BigQuery, Composer, GCS, DataStream, Dataflows.
• Should have expert level understanding of Data Architecture, Data Warehousing, Cloud Data Platform, ETL (FiveTran), Data Quality, Data Mapping etc.
• Hands on experience working in GCP services like Big Query, Cloud Com