Senior Data Engineer - Snowflake (Remote)

About SailPoint

SailPoint is the leader in identity security for the cloud enterprise. Our identity security solutions secure and enable thousands of companies worldwide, giving our customers unmatched visibility into the entirety of their digital workforce, ensuring workers have the right access to do their job – no more, no less.

Want to be on a team that’s full of results-driven individuals who are constantly seeking to innovate? At SailPoint, our Engineering team does just that. We value high-quality collaborative engineering driven by focused individuals. Our team creates products that are built on strong technical foundations, agility to respond to market demands, and frequent shipping to customers.

About the Team

SailPoint is seeking a Senior Data Engineer to help build a new cloud-based SaaS identity security product. We are seeking a highly motivated and experienced Senior Data Engineer to design, build, and maintain our robust data ecosystem. This role will focus on creating scalable and reliable data pipelines using a diverse and modern data stack. The ideal candidate will have hands-on experience with both batch and streaming data processing, as well as a strong understanding of various database technologies, including columnar, NoSQL, and graph databases.

As one of the first members on the team, you will be integral in building this product and will be part of an agile team that is in startup mode. This is a unique opportunity to grow a project that is in it’s early stages but with the backing of an organization that has the muscle to take it to market quickly, with a broad and engaged customer base.

Responsibilities

• Data pipeline development: Design, construct, and optimize scalable ETL/ELT pipelines for both batch and real-time data using DBT, Apache Spark and Apache Flink.

• Data warehousing: Develop and manage data schemas and warehouses within Snowflake, ensuring data is organized for efficient querying and analysis.

• Database management: Collaborate with infrastructure teams to administer and optimize data storage solutions using Cassandra for high-velocity, wide-column data, and graph databases for complex relationship-based data.

• Real-time streaming: Build and maintain data ingestion workflows for real-time applications using Apache Flink to process data from sources like Apache Kafka.

• Performance optimization: Tune complex Spark, Flink, SQL, and CQL queries to improve performance and reduce cost within Snowflake and other database systems.

• Data quality and governance: Implement and enforce data quality standards, monitor pipelines, and establish data governance policies to ensure data integrity and security.

• Infrastructure management: Collaborate with DevOps teams to manage and automate the deployment of data applications using CI/CD pipelines.

• Collaboration: Work with data scientists, BI analysts, and other stakeholders to translate complex data requirements into scalable engineering solutions.

Requirements

• Education: Bachelor's degree in Computer Science, Engineering, or a related technical field.

• Experience: 6+ years of professional experience in data engineering or a similar role.

• Programming: Strong proficiency in programming languages like Python, Scala, or Java.

• Data warehousing: Expert-level knowledge of Snowflake for data warehousing, including data modeling and query optimization.

• Batch processing: Hands-on experience with Apache Spark for large-scale data processing.

• Streaming processing: Experience with Apache Flink for building real-time data streaming applications.

• NoSQL databases: Strong experience with Cassandra for managing and optimizing distributed data storage.

• Graph databases: Solid understanding and hands-on experience with graph databases and their query languages (e.g., Gremlin, Cypher).

• Cloud experience: Familiarity with a major cloud provider (e.g., AWS, Azure, GCP) and its data-related services.

Preferred qualifications

• Experience with other components of the big data ecosystem (e.g., DBT, Apache Kafka, Airflow).

• Experience with containerization technologies like Docker and Kubernetes.

• Familiarity with data governance and observability tools.

• Cert