Jobs and Careers

Senior Manager, Data Engineering (GCP, Data Lake)

United States, United StatesRemotefull_timeVerifiedPosted 31 Jan 2025

About the role

Job Overview

Applied Systems, Inc., a worldwide leader in insurance technology, is searching for a Senior Manager, Data Engineering (GCP, Data Lake). This critical role involves leading a highly skilled engineering team to design, develop, and scale our Data Lake platform, which is integral to our organization’s success. The ideal candidate will bring a strong technical background, proven leadership skills, and a track record of delivering results in high-stakes environments.

As our Data Lake platform continues to grow, this leader will play a key role in onboarding new clients, improving user experience, and building a scalable technical and product roadmap.

What You’ll Do

Strategic Leadership:
- Manage and guide a team of about eight developers, balancing priorities across multiple concurrent projects.
- Collaborate with Product Management, Architecture, and other Engineering Leaders to align technical delivery with strategic goals.
- Define clear team goals and establish data-informed processes to measure success.
Platform Development & Delivery:
- Lead the design, implementation, and optimization of scalable data pipelines using technologies like Debezium, Pub/Sub, Dataflow, and BigQuery.
- Oversee ETL processes to ensure seamless data ingestion and transformation from sources such as MS SQL Server.
- Develop APIs and services, leveraging Python, Golang, and Terraform to enhance platform functionality and reliability.
Operational Excellence:
- Drive the team to meet deadlines and deliverables, managing competing priorities while maintaining high standards.
- Monitor and optimize active work, reducing scope changes, addressing blockers, and fostering cross-team collaboration.
- Conduct code reviews, enforce best practices, and ensure maintainability and quality in codebases.
Continuous Improvement:
- Stay ahead of industry trends in data engineering and cloud technologies to implement cutting-edge solutions.
- Identify opportunities for process optimization to improve team efficiency and platform scalability.
- Foster a culture of innovation, mentorship, and professional development.

What You’ll Need to Succeed  

We’re looking for someone who:

Can work 100% remotely, or from an Applied Systems office

Your experience should include some or all of the following:

8+ years of experience creating enterprise software
3+ years managing software engineering teams
Technical Skills:
Deep expertise in GCP services (Compute Engine, Cloud Storage, Networking, Security, IAM, Debezium, Pub/Sub, Dataflow, BigQuery).
Terraform: Extensive experience in infrastructure-as-code using Terraform, including module development, state management, and CI/CD integration.
Kubernetes:Solid understanding of Kubernetes architecture and experience managing production-grade Kubernetes clusters on GKE.
Data Engineering: Strong knowledge of data warehousing principles, ETL processes, and data modeling. Familiarity with data quality and governance frameworks.
Scripting/Programming: Proficiency in Python or other relevant scripting languages for automation and tooling.
Monitoring and Logging: Experience with monitoring and logging tools such as Prometheus, Grafana, and Cloud Logging
Proven experience in managing a software engineering team with a focus on ETL processes
Strong problem-solving abilities and results-driven mindset
Experience with Scrum practices and tools like Jira and Confluence
Bachelor's degree in computer science or related field, or equivalent work experience
We proudly support and encourage people with military experience, as well as military spouses, to apply