Senior Software Engineer (Spark) - Cloud Data Platform

Summary

Guidewire Software is an insure-tech software company with more than 3,200 people in 40+ countries worldwide. We are an internet-scale, cloud-native, real-time data platform built for the property and casualty insurance industry worldwide.

Are you passionate about building internet-scale multi-tenant cloud-native data platforms?

Do you have prior experience in building data platforms/data lake and analytics SaaS services in the public cloud with expertise in modern Big Data stack (Apache Spark, Hadoop, Kafka, Flink, Hive etc.)

If so then come join our Cloud Data Platform team! This team owns, builds, and operates Guidewire’s cloud-native data platform and analytics SaaS offerings. The Guidewire Data Platform is an enterprise-grade, internet-scale, and cloud-native Big Data platform targeted to be best-in-class in enabling our customers with mission-critical insights and decision-making capabilities.
 
The platform is designed to support all our analytics, data science, and data applications. Guidewire’s data platform already processes Billions of real-time data to provide a rich set of AI/ML SaaS solutions! You will work in a highly collaborative environment building next-generation platforms and services using the latest and greatest cutting-edge & bleeding-edge technologies.  You will have fun building cloud-native, enterprise-grade, and internet-scale platforms and SaaS applications.

Job Description

Required Skills:

• 8+ years' experience working in a similar Senior Software Engineer role within a data platform/data engineering team
• Extensive experience with Big Data and distributed systems.
• Experience with stream processing using Spark.
• Ability to design large-scale distributed systems.
• Prior experience in building data platforms using Big Data stack (Kafka, Hadoop, Spark, Flink, Hive ..) on the public cloud.
• Excellent programming skills in Java.
• Understanding of distributed systems concepts and principles (consistency and availability, liveness and safety, durability, reliability, fault-tolerance, consensus algorithms).
• Deep understanding of Algorithms, Data Structures, and Performance Optimization Techniques.
• Eager to learn new things and passionate about technology!.
• Comfortable working with Kubernetes, AWS, Docker, and Terraform.

What you would do:

• Hands-on coding and implementation of high-performance Spark applications, leveraging your deep understanding of distributed computing and data processing.
• Designing and optimizing Spark applications.
• Design cloud-native data platform and analytics SaaS services
• Own architecture and provide technical leadership to multiple teams
• Hands-on coding>60% of the time
• Design and build large-scale real-time stream processing systems
• Design and develop micro-services and analytics SaaS solutions
• Own scalability, availability, and data security
• Own, tackle & resolve code defects
• Mentor junior developers in standards and best practices!

What you would need to succeed:

• Extensive experience working on a public cloud-like AWS
• Prior experience and passion for building a large-scale multi-tenant cloud-native data platform
• Emphasize team wins over individual success
• Strong technical interpersonal skills
• Excellent software development skills in one or more of the following languages: Java/Scala
• Extensive experience with Big Data and distributed systems.
• Expertise in Spark or Flink, Kafka, and Hadoop ecosystem
• Ability to design large-scale distributed systems
• Have developed in more than one language and ready to pivot to any language/framework
• Understand microservices architecture patterns pattern like Service Discovery/API Gateway/Domain Driven Design etc
• Experience with containers technology
• Ability to work in an agile fast-paced environment
• BS or MS degree (Computer Science or Math)

Bonus

• AWS (EMR, S3, Glue, Kinesis)
• Debezium
• ELK
• Experience in building SaaS/PaaS on AWS/GCP/Azure.
• AI/ML

The US base salary range for this full-time position is $144,000 - $240,000 + bonus + equity + benefits. Our salary ranges are determined by role, level, and location. The range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position across all US locations. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training. Your recruiter can share more about the specific salary range for your preferred location during the hiring process.

Disability Accommodations and Guidewi