Data Engineer III

Are you looking to work for a company that has been recognized for over a decade as a Top Place to Work? Apply today to become a part of a company that continues to commit to putting our employees first.

Job Description:

The Data Engineer III is a subject matter expert within the Software Development team and will support the Data Management team by implementing new and maintaining existing data flows and dimensional models with a focus on consistent and accurate enterprise data solutions on premise and in the cloud.

Position will bridge the gap between on premise, SQL-based Data Warehousing solution and future state Azure/Databricks Lakehouse architecture; learning and supporting the existing proprietary system while working with technical leaders to further develop plans to migrate to a cloud-based solution.

Essential Functions:

• Takes part in regular Scrum activities (daily standup meetings, weekly planning poker, post-sprint retrospectives, etc.)

• Develops foundational patterns to be utilized by other members of the business intelligence team

• Addresses issues in data flow logic and data model design, as well as the interoperability of new datasets with existing data models

• Participates in and conducts code-reviews for all changes to the codebase and conveys coding standards clearly and concisely

• Tests work on each assignment before working with Product Owners to ensure business requirements are fulfilled

• Performance tunes ETL/ELT processes, queries, notebooks, and other data flows

• Coordinates identification of requirements and recommending new data features in conjunction with development manager, product owners, and department managers

• Acts as a subject matter expert by sharing information and providing support and training to others, as well as spearheading team projects and establishing goals and milestones for projects

• Ensures goals and commitments to the team are met

• Adheres to the company’s Compliance Program and to federal and state laws and regulations

• Other duties as assigned

Knowledge, Skills and Abilities:

• Extensive experience with the Databricks platform under Microsoft Azure (ADF, ADLS, Databricks Delta Lake, Databricks Unity Catalog, SQL Serverless, Auto Loader, etc.)

• Advanced familiarity with on premise ETL frameworks, data modelling tools, relational database design, dimensional modelling, and SQL

• Intermediate familiarity with the C# language

• In-depth knowledge of data integration strategies and supporting technologies

• In-depth knowledge of standards used for electronic data exchange (FHIR, HL7, CSV, EDI, etc.)

• Ability to mentor others

• Excellent verbal and written communication skills

• Great customer service skills

• Great teamwork and leadership skills

• Independent problem-solving skills

• Self-motivated and self-managed

• Proficient in Microsoft Office Suite

Qualifications:

• Bachelor’s degree in computer science, information systems, or equivalent work experience

• 7+ years working with the following concepts and technologies:

  • Relational and Dimensional Data Models, T-SQL, Microsoft SQL Server, etc.

• 3+ years working with the Databricks Platform under Azure, designing, and implementing a lake house architecture

• Experience migrating on premise data warehousing solutions to Azure solutions (preferred)

• Experience with Visual Studio and .NET technologies such as C# (preferred)

• Experience working on an agile/scrum-driven software development team (preferred)

• Experience working with common health care datasets (preferred)

• Home office that is HIPAA compliant for all remote or telecommuting positions as outlined by the company policies and procedures

Salary Range:

$90,000-135,000