Data Architect (Microsoft)

Overview

At Carenet Health, the Data Architect plays a critical role in designing and implementing scalable, secure, and modern cloud data solutions. Leveraging expertise in Azure cloud data services and Medallion Architecture principles, the Data Architect ensures data systems are robust, efficient, and aligned with the organization's business objectives. This hands-on role requires advanced technical proficiency with Microsoft Fabric, One Lake, and related Azure services to build data workflows, optimize platforms, and drive innovative solutions that deliver measurable business value.

Responsibilities

Responsibilities and Duties

Data Architecture Design: Create and implement data architectures based on Medallion principles, organizing data into Bronze (raw), Silver (cleaned), and Gold (curated) layers to support analytics and business needs.

Microsoft Fabric Implementation: Utilize Microsoft Fabric services, including One Lake, Fabric Data Factory, and Fabric Real-Time Analytics, to enable unified and scalable data solutions.

Data Pipeline Development: Design and manage data ingestion pipelines using Azure Data Factory and Fabric Data Engineering, ensuring the seamless integration of raw data.

Data Transformation: Build and manage transformation workflows for Silver and Gold layers, ensuring data accuracy, deduplication, and optimization for reporting and analytics.

Streaming Data Integration: Integrate streaming data into Medallion layers using tools like Azure Event Hub and Databricks Structured Streaming.

Governance and Compliance: Enforce data governance best practices, including metadata management, lineage tracking, and quality assurance, leveraging Azure Purview.

Secure Data Access: Design and implement secure access strategies using Role-Based Access Control (RBAC) and Azure Active Directory (AAD).

Stakeholder Collaboration: Work closely with stakeholders, data engineers, and analysts to align data architecture and solutions with business requirements.

Documentation: Document data architectures, workflows, and design decisions to ensure clarity, reproducibility, and alignment with organizational goals.

Performance Optimization: Monitor, troubleshoot, and optimize data pipelines, queries, and storage solutions using tools like Delta Lake, Synapse SQL pools, and Databricks.

Real-Time and Batch Processing: Develop both real-time and batch data processing solutions using Microsoft Fabric, Azure Synapse Analytics, and Azure Event Hub.

Continuous Learning: Stay current with emerging technologies, Azure services, and industry trends to identify and implement enhancements in data architecture.

Qualifications

Qualifications

Technical Expertise:

• Strong experience with modern data architecture, particularly Medallion Architecture (Bronze, Silver, Gold layers).
• Proficient in Microsoft Fabric tools, including One Lake, Fabric Data Factory, and Fabric Real-Time Analytics.
• Hands-on experience with Azure Data Factory, Azure Synapse Analytics, Azure Data Lake Storage, and Databricks.
• Governance Knowledge: Familiarity with Azure Purview for managing metadata, lineage, and compliance.
• Programming Skills: Proficiency in T-SQL, Python, or Scala for creating and optimizing data workflows.
• Pipeline Design: Proven ability to design and manage scalable, efficient ETL/ELT pipelines.

Certifications (Preferred but not Required):

• Microsoft Certified: Azure Data Engineer Associate
• Microsoft Certified: Azure Solutions Architect Expert
• Databricks Certified: Data Engineer Associate

Education and Experience:

• Bachelor’s degree preferred in Information Systems, Computer Science, or a related field.
• 5+ years of experience in data architecture and engineering, or an equivalent combination of education and experience.

Additional Skills:

• Knowledge of Power BI for developing analytics and BI solutions is a plus.

Working Conditions

Environment:

• Remote po