Principal Data Engineer

Group 1001 is a consumer-centric, technology-driven family of insurance companies on a mission to deliver outstanding value and operational performance by combining financial strength and stability with deep insurance expertise and a can-do culture. Group1001’s culture emphasizes the importance of collaboration, communication, core business focus, risk management, and striving for outcomes. This goal extends to how we hire and onboard our most valuable assets – our employees.

Group 1001, and its affiliated companies, is strongly committed to providing a supportive work environment where employee differences are valued. Diversity is an essential ingredient in making Group 1001 a welcoming place to work and is fundamental in building a high-performance team. Diversity embodies all the differences that make us unique individuals.  All employees share the responsibility for maintaining a workplace culture of dignity, respect, understanding and appreciation of individual and group differences.

Role Overview

As a Principal Data Engineer, you will play a crucial role in our data engineering initiatives, responsible for designing, implementing, and optimizing our data infrastructure. Your expertise will enable our organization to rapidly transform data into actionable insights. You will oversee the entire lifecycle of data management, from ingestion and processing to securing and delivering data across the organization. By leveraging your knowledge of analytical data stores, data orchestrators, and data security, you will ensure our data platforms are robust, scalable, and compliant with industry standards.

Your primary objective is to accelerate our transformation and drive innovation in data analytics, positioning Group 1001 at the forefront of the field. Your efforts will have a direct impact on our ability to harness data for strategic decision-making, driving our business forward. By leveraging the latest advancements in data, analytics, and AI, you will help build a world-class team that excels in operational efficiency and sets new standards in data analytics.

Responsibilities

• Architect and Data Infrastructure:

  • Enable Data Analytics platform that process, store, and organize critical organizational data, delivering from idea to insight in days.

  • Optimize, manage, and deploy analytical data stores like Snowflake across organization to scale data analytics workloads

  • Ensure the data infrastructure is robust, scalable, and capable of supporting advances analytics initiatives.

• Data Orchestration and Workflow Management:

  • Implement and manage data workflows and orchestrations using modern data orchestrators like Dagster or Airflow.

  • Ensure data pipelines are automated, monitored, and resilient to failures.

  • Design and develop frameworks, tools, and processes to reliably and repeatably ingest and process data into our data platform.

• Data Security and Privacy:

  • Implement robust data security measures to protect sensitive data.

  • Ensure compliance with data privacy regulations and industry best practices.

  • Conduct regular security audits and assessments to identify and mitigate risks.

• Collaboration and Leadership:

  • Lead and mentor a team of data engineers, providing technical guidance and support.

  • Work closely with stakeholders to define data requirements and deliver solutions that meet business needs.

  • Foster a culture of continuous improvement and innovation within the data engineering team.

• Performance Optimization and Monitoring:

  • Monitor and optimize the performance of data pipelines and storage solutions.

  • Troubleshoot and resolve data-related issues in a timely manner.

  • Implement monitoring and alerting systems to proactively identify and address potential problems.

Requirements

• 12+ years of experience working in data engineering or related data solution role.

• Experienced in implementing and optimizing cloud data platforms such as Snowflake.

• Hands-on experience with data orchestrators like Apache Airflow or Dagster.

• Experienced in handling real-time streaming and batch-based architectures.

• Strong understanding of data security principles and data privacy regulations.

• Proficiency in SQL, Python, and other relevant programming languages.

• Experience with cloud platforms such as AWS, GCP, or Azure.

• Excellent problem-solving skills and attention to detail.

• Strong communication and leadership abilities.