Senior Data Architect

The Role

We are seeking an experienced Senior Data Architect to design and implement comprehensive data platform solutions. The ideal candidate will have deep expertise in cloud-native data architectures and hands-on experience with modern data engineering technologies.

You will have the opportunity to contribute to one of our projects for a leading consumer healthcare navigation company by creating a Minimum Viable Product (MVP) that offers health insurance visualizations and insights. The goal is to help users make more informed decisions about their health insurance.

What you will do

• Data Platform Architecture & Design:
  • Design and architect scalable data platform solutions incorporating Control Plane APIs, data ingestion interfaces, and polyglot (multi-type data) storage systems.
  • Develop comprehensive data modeling strategies for analytical and transactional workloads.
  • Design standardized streaming (real-time CDC) and batch ingestion interfaces
  • Architect customizable ingestion mediation, transformation, and microservice components.
  • Design & Develop macros and models in dbt (data build tool).
    
• Cloud Infrastructure & Data Engineering:
  • Design and implement cloud-native data solutions using AWS services, including AWS Glue and AWS DMS.
  • Architect ETL/ELT pipelines with a focus on incremental data ingestion and batch data processing.
  • Design and implement streaming data architectures using Kafka.
  • Design & develop Infrastructure as Code solutions using Terraform.
    
• Data Storage & Management:
  • Architect polyglot data storage solutions spanning PostgreSQL, MySQL, MS SQL Server, GraphQL, and Snowflake.
  • Implement Snowflake performance tuning and optimization strategies.
  • Design Data Lifecycle Management (DLM) and Information Lifecycle Management (ILM) frameworks.
  • Develop data sovereignty and residency compliance strategies.
    
• Security & Governance:
  • Design Role-Based Access Control (RBAC) systems and access/change auditing capabilities.
  • Implement secrets management solutions using AWS Secrets Manager
    Architect TLS (in-flight) and TDE (at-rest) encryption capabilities.
  • Develop data steward governance frameworks and data catalog solutions
    
• Integration & APIs:
  • Design standardized query APIs and data export interfaces.
  • Architect GraphQL APIs for data access.
  • Develop Change Data Capture (CDC) solutions for real-time data synchronization.
  • Create standardized push API ingestion interfaces.
    
• Operations & Monitoring:
  • Design operational metrics, monitoring, and alerting capabilities with centralized dashboards.
  • Implement health checks and resource utilization tracking systems.
  • Develop cost allocation and client platform resource tracking capabilities.
  • Design Non-Functional Requirements (NFR), including DR, availability, and performance capabilities.

Requirements

• Technical Skills:
  • Cloud Platforms: Extensive experience with AWS services.
  • Data Warehousing: dbt, Snowflake experience, including performance tuning and optimization.
  • Databases: Proficiency in PostgreSQL, MySQL, and MS SQL Server.
  • Programming: Advanced Python and SQL skills.
  • Data Integration: Hands-on experience with AWS Glue, AWS DMS, and Kafka.
  • APIs: Experience with GraphQL and standardized query APIs.
  • Security: Knowledge of AWS Secrets Manager and encryption technologies.
  • Data Engineering: Strong background in ETL/ELT, CDC, incremental data ingestion, and batch processing.
  • Infrastructure: Expertise in Infrastructure as Code using Terraform.
• Architecture Experience:
  • 5+ years of data architecture experience with a focus on enterprise data platforms.
  • Strong background in data modeling and polyglot storage architectures.
  • Experience with CI/CD and Infrastructure as Code implementations.
  • Knowledge of data governance, RBAC, and compliance frameworks.

Nice to have:

• Experience with data catalog implementations and data stewardship programs.
• Background in cost optimization and resource allocation for data platforms.
• Knowledge of data sovereignty and residency requirements.
• Experience with operational monitoring and alerting systems for data platforms.

What we offer

• Hybrid/flexible working m