Sr. Principal Data Engineer

Overview

PURPOSE STATEMENT:

 

We are looking for an experienced Senior Principal Data Engineer to architect, build, and maintain the data infrastructure and pipelines that power our analytics and machine learning platforms. In this role, you will collaborate with stakeholders across business units to understand data needs and then design optimal technical solutions leveraging tools like Snowflake, Airflow, etc on Cloud platforms (Azure preferred).  This can be 100% remote.

Responsibilities

ESSENTIAL FUNCTIONS:

 

Data Modeling and Integration:

• Develop and maintain complex data models, including relationships, hierarchies, and calculated columns.
• Integrate data from multiple sources, ensuring consistency and accuracy

 Report and Dashboard Development:

• Design and create interactive, visually compelling reports and dashboards using Power BI Desktop.
• Implement advanced features like bookmarks, drill-through actions, and custom visuals

 Advanced Data Analysis:

• Perform complex data analysis using DAX (Data Analysis Expressions) to create calculated measures and solve intricate business problems
• Develop advanced DAX calculations for financial, statistical, or performance analysis

 Performance Optimization:

• Optimize report and dashboard performance by improving data queries, data model efficiency, and report rendering speed
• Identify and address bottlenecks and resource constraints

Data Transformation and ETL:

• Handle complex data transformation and ETL (Extract, Transform, Load) processes, including handling data from multiple sources and dealing with complex data structures

 Data Governance and Security:

• Implement data governance practices, including data access controls, role-level security, and data lineage documentation
• Ensure compliance with data protection regulations

 Collaboration and Requirements Gathering:

• Collaborate closely with business analysts, stakeholders, and end-users to gather and refine requirements for reports and dashboards
• Act as a bridge between technical and non-technical stakeholders 

Mentoring and Leadership:

• Guide and mentor junior developers and team members in best practices and advanced techniques in Power BI
• Lead projects and ensure the delivery of high-quality business intelligence solutions

STANDARD EXPECTATIONS:

• Complies with organizational policies, procedures, performance improvement initiatives and maintains organizational and industry policies regarding confidentiality
• Communicate clearly and effectively to person(s) receiving services and their family members, guests, and other members of the health care team
• Develops constructive and cooperative working relationships with others and maintains them over time
• Encourages and builds mutual trust, respect, and cooperation among team members
• Maintains regular and predictable attendance

Qualifications

EDUCATION/EXPERIENCE/SKILL REQUIREMENTS:

• BS/MS degree in Computer Science, Engineering or equivalent field
• Deep hands-on development and administration experience with Snowflake as a must-have
• Deep hands-on experience with Apache Airflow (Astronomer) and Python as a must-have
• 7+ years hands-on engineering and administration experience in data engineering on cloud platforms (Azure preferred) with RDBMS such as SQL Server, PostgreSQL, MySQL.
• Extensive working experience with Azure ADF, ADLS and Synapse.
• Expert knowledge of SQL and experience with Spark, Python for data transformation/processing
• Experience building and optimizing data pipelines at scale with orchestration tools like AirFlow and observability tools like ELK
• Excellent communication skills collaborating cross-functionally with stakeholders
• Self-directed and passionate about keeping up with latest innovations in the data space
• API development experience is a plus

Technical Skills:

 

Power BI Proficiency:

Extensive experience with Power BI Desktop, Power BI Service, and Power BI Mobile

Strong skills in creating complex reports, dashboards, and data visualizations

 

Data Modeling and DAX:

Proficiency in data modeling, including creating relationships, hierarchies, and calculated columns

Advanced knowledge of DAX (Data Analysis Express