Principal Software Data Engineer

Overview:  The principal software data engineer is a hands-on architecture role to drive end-to-end build of next generation data & reporting platform. They will support existing data operations such as data pipeline, ETL, data lake / warehouse, data structure development, and troubleshooting of data issues. They will be part of the team which is building next generation data & reporting platform. This platform will cater internal business stakeholders and external customers to provide insights & forecasting to understand current state of business, improve decision-making for their tactical and strategic goals & KPIs. This position will require collaborating with internal business stakeholders and external customers.

Duties and Responsibilities:

• Collaborate with business stakeholders, product owners, business analysts to understand various LOBs data and reporting needs to create architecture & design for data & reporting platform on Azure Public Cloud.
• Architect & design end to end platform components including data ingestion, ETL, data warehouse (star, snowflake, traditional), data export framework, data marts, data analytics & visualization design on Power BI.
• Create quality diagrams (architecture, component, flow, contextual etc.) and detail design documents & groom user stories for engineers to work.
• Design various components of data & reporting platform including data ingestion pipeline, validation & cleansing framework, data warehouse, data marts/sets, data export to generate files & populate data marts utilizing MS SQL Server and ADF (Azure Data Factory) or like technologies.
• Design optimized & organized data marts for data analytics and visualization with SQL Server and Power BI.
• Design custom web app for custom query, confirmation management, role management and embed Power BI dashboards and custom export & query framework.
• Design data models/sets in Power BI utilizing best practices and concepts like multi-dimensional data models, dashboards with charts, graphs, drill downs, heat maps etc.
• Lead performance improvement efforts utilizing caching techniques, API integrations & SQL queries to load large amount of data.
• Design & write quality high level and detail design documents, create effective & clear visual design diagrams of various levels targeting business stakeholders to engineers.
• Design security aspects at various technical components integrating with Azure AD for end-to-end platform including row level security in Power BI reporting.
• Work in agile model to write technical features, groom user stories for developers and work with team to explain technical design and resolve their issues.
• Perform code reviews and performance aspects of all technical components.
• Research new patterns, frameworks, tools to make data platform capabilities configurable, dynamic, reliance and performant, adhere to SLAs & quick time to market.
• Maintain compliance with ComplexCare Solutions policies, procedures, and mission statement.
• Adhere to all confidentiality and HIPAA requirements as outlined within ComplexCare Solutions Operating Policies and Procedures in all ways and at all times with respect to any aspect of the data handled or services rendered in the undertaking of the position; and
• Fulfill those responsibilities and/or duties that may be reasonably provided by ComplexCare Solutions for the purpose of achieving operational and financial success of the Employer.

Job Requirements:

• Minimum 10 years of relevant industry experience in data & reporting field, Healthcare experience is big plus
• Hands-on SQL, data & reporting tools (Power BI) and databases (MS SQL Server)
• 10+ years of experience in design and architecture of data warehouse, ETL, data exports, analytics & reporting
• 5+ years of experience in Microsoft SQL Server, SQL, SSIS packages
• 5+ years of experience in design and architecture of data warehouse, ETL, data exports, analytics & reporting
• 2+ years of experience in Databricks pipeline, lakehouse, Unity Catalog, DLTs etc.
• 3+ years of experience in application development using Angular, .Net, APIs are a plus3+ years on designing reporting on Power BI analytics tool and web application
• 3+ years’ experience working on Azure Cloud is preferred utilizing ADF (Azure Data Factory), Azure Delta Lake, Azure SQL Server, Data Sync, Log Insights and Analytics
• Expert troubleshooter – unwilling to let a problem defeat you; unrelenting, persistent, confident
• A penchant for thinking outside the box to solve complex and interesting problems
• Extensive knowledge of existing industry standards, technolo