Lead Clinical Data Warehouse Engineer - Scientific Computing & Data
Mount Sinai Health SystemAbout the role
Strength Through Diversity
Ground breaking science. Advancing medicine. Healing made personal.
Roles & Responsibilities:
The Scientific Computing & Data group at the Icahn School of Medicine at Mount Sinai partners with scientists to accelerate scientific discovery. To achieve these aims, we support a cutting-edge high-performance computing (HPC) and data ecosystem along with MD/PhD-level support for researchers. The group is composed of a high-performance computing team, the research clinical data warehouse team and a research data services team.
The Lead Clinical Data Warehouse Engineer is a senior technical specialist responsible for leading the ongoing development of the Mount Sinai Data Warehouse (MSDW), a centralized data repository for biomedical research within the Icahn School of Medicine at Mount Sinai. In this position, the Lead Clinical Data Warehouse Engineer will work with other members of the data warehouse team to expand the functionality and integrate new data sources into MSDW and other research databases. MSDW is built on the Microsoft SQL Server technology stack, with data extracted from Mount Sinai’s clinical systems, especially the Epic Caboodle data warehouse, and transformed into OHDSI’s Observational Medical Outcomes Partnership (OMOP) Common Data Model.
This work supports major national and regional research projects and data-sharing initiatives such as the NIEHS-funded national Human Health Exposure Analysis Resource (HHEAR), the INSIGHT Clinical Research Network, the NIH’s National COVID Cohort Collaborative (N3C), and others.
- Design, build, test, maintain, and control data pipelines and ETL jobs for integrating data into the Mount Sinai Data Warehouse (MSDW) and other research databases. Such data pipelines are implemented in T-SQL stored procedures, SSIS, and SQL Agent jobs, and make extensive use of metadata-driven dynamic SQL and Varigence’s BIML.
- Develop standards and procedures for database and data pipeline design, operational management, and ongoing maintenance.
- Design, build, test, maintain, and control other processes for data management, including management and loading of flat files in a variety of formats (e.g., csv, tsv, pipe-delimited, XML, JSON).
- Facilitate design sessions, code walkthroughs, peer reviews, and produce technical documentation.
- Performance tuning of database objects, stored procedures, ETL jobs, and related scripts to optimize both end-user customer queries and data pipeline ETL processing.
- Monitor scheduled ETL jobs and other processes to ensure expected functioning and uptime of data pipelines. Lead and/or coordinate the troubleshooting and remediation of all ETL job failures in a timely manner. On-call support is sometimes required.
- Deliver world-class customer service in all interactions with customers, stakeholders, and other teams within Mount Sinai’s Digital & Technology Partners (DTP) organization. Maintain a customer-focused approach to provide solutions that are science/research-driven.
- Maintain patient privacy and the integrity and security of healthcare data in all databases and systems, including compliance with all applicable laws, regulations, and Mount Sinai’s policies related to its Institutional Review Board (IRB), patient privacy, and IT cybersecurity. These laws include, but are not limited to, the “Common Rule” (45 CFR Part 46), HIPAA (45 CFR Part 164), 42 CFR Part 2, and New York’s Article 27-F.
- Work effectively and collaboratively with other IT professionals throughout Mount Sinai.
- As a senior technical lead, independently investigate and stay abreast of new and emerging technologies that Scientific Computing & Data could leverage to provide new capabilities, to boost efficiencies or quality, and/or lower operating costs.
- May act as a project leader.
- May assist the DBAs with database administration tasks, including user provisioning and access permissions, backups, environment restorations, capacity planning and load monitoring, performance tuning, etc.
- May assist with the design, build, test, and performance tuning of reports and dashboards in SSRS, Microsoft Power BI, Tableau, or similar business intelligence tools.
- Performs related duties as assigned or requested.
- Bachelors degree in a technical discipline; Masters degree preferred
- Ten years of related experience, In -depth knowledge of associated technology areas that could impact area of responsibility; healthcare technology experience preferred.
- At least seven years of demonstrated experience supporting, creating, modifying and maintaining ETL jobs
- Minimum of 5 years’ experience working with electronic health record (EHR) and/or healthcare claims data; experience with Epic
Apply for this role
Generate a tailored application kit with a matched cover letter, interview prep, and CV highlights — in under 60 seconds.
Apply Now →Generate Application KitFree account required — sign up in 30s