Lead Clinical Data Warehouse Engineer - Scientific Computing & Data

The Scientific Computing & Data group at the Icahn School of Medicine at Mount Sinai partners with scientists to accelerate scientific discovery. To achieve these aims, we support a cutting-edge high-performance computing (HPC) and data ecosystem along with MD/PhD-level support for researchers. The group is composed of a high-performance computing team, the research clinical data warehouse team and a research data services team. The Scientific Computing and Data group operate the secure enclave for the Kidney Precision Medicine Project (KPMP) clinical data warehouse and data lake for the KPMP. The Kidney Precision Medicine Project (KPMP) is an ambitious, multi-year project funded by the National Institute of Diabetes and Digestive and Kidney Diseases (NIDDK) with the purpose of understanding and finding new ways to treat chronic kidney disease (CKD) and acute kidney injury (AKI). 

The Lead Clinical Data Warehouse Engineer is a senior technical specialist responsible for leading the ongoing development of the Kidney Precision Medicine Project (KPMP) data warehouse, a centralized multimodal data repository for biomedical research. In this position, the Lead Clinical Data Warehouse Engineer will work with other members of the data warehouse team and KPMP to expand the functionality and integrate new multimodal data sources into the data warehouse.  The KPMP data warehouse is built on the Microsoft SQL Server technology stack, with data extracted from KPMP’s clinical systems, and transformed into OHDSI’s Observational Medical Outcomes Partnership (OMOP) Common Data Model.

This position is responsible for driving and leading the technology direction of current and future development in an area of expertise which may include application development, systems programming, data management, etc. This individual may function as a team lead and influences strategic technical implementation and provides creative solutions for very complex requirements often leading large project efforts. Project Scope: Large complex programs and strategic initiatives involving multiple sites or up to 40 integrated work tracks.

• Design, build, test, maintain and control data pipelines and ETL jobs for integrating data into the KPMP data warehouse.  Such data pipelines are implemented in T-SQL stored procedures, SSIS and SQL Agent jobs, and make extensive use of metadata-driven dynamic SQL and Varigence's BIML.
• Develop standards and procedures for database and data pipeline design, operational management and ongoing maintenance.
• Design, build, test, maintain, and control other processes for data management, including management and loading of flat files in a variety of formats (e.g. csv, tsv, pipe-delimited, XML, JSON.)
• Facilitate design sessions, code walkthroughs, peer reviews, and produce technical documentation.
• Performance tuning of database objects, stored procedures, ETL jobs, and related scripts to optimize both end-user customer queries and data pipeline ETL processing.
• Monitor scheduled ETL jobs and other processes to ensure expected functioning and uptime of data pipelines.  Lead and/or coordinate the troubleshooting and remediation of all ETL job failures in a timely manner.  On call support is sometimes required.
• Deliver world class customer service in all interactions with customers, stakeholders, and other teams within Mount Sinai's Digital & Technology Partners (DTP) organization.  Maintain a customer-focused approach to provide solutions that are science/research driven.
• Maintain patient privacy and the integrity and security of healthcare data in all databases and systems, including compliance with all applicable laws, regulations, and Mount Sinai's policies related to the Institutional Review Board (IRB), patient privacy and IT cybersecurity.   These laws include but are not limited to, the "Common Rule" (45 CFR Part 46), HIPAA (45CFR Part 164), 42 CFR Part 2, and New York's Article 27-F.
• Work effectively and collaboratively with other IT professionals throughout Mount Sinai.
• As a senior technical lead, independently investigate and stay abreast of new and emerging technologies that Scientific Computing & Data could leverage to provide new capabilities, to boost efficiencies or quality, and/or lower operating costs.
• May act as a Project Leader.
• May assist the DBAs with database administration tasks, including user provisioning and access permissions, backups, environment restorations, capacity planning and load monitoring, performance tuning, etc.
• May assist with the design, build, test and performance tuning of reports and dashboards in SSRS, Microsoft Power BI, Tableau, or similar business intelligence tools.

• Perform related duties as assigned or requested.

   

• Bachelors degre