Senior Data Engineer

JupiterOne is a fast growing, cyber security company named in America’s Top Startup Employers for 2023 by Forbes and trusted by cloud-first companies like Hashicorp, Databricks, Marqeta, Divvy, Auth0, and more. JupiterOne earned the trust of Fortune 100 customers and gained more than $119M in funding and support from investors, and advisors like Sapphire Ventures, Bain Capital Ventures, Cisco Investments, Splunk Ventures, Intel Capital, and Alpha Square Group.
As a Senior Data Engineer, you will help shape the future of our data platform with special emphasis on end-to-end data ingestion and processing within the product. We are looking for someone who is comfortable applying modern approaches to challenging engineering problems involving large, semi-structured data. This role will require close collaboration with software engineers and fellow data experts on both technical design and implementation. You must be comfortable with ambiguity and able to communicate effectively with both technical and non-technical audiences. You will also be expected to mentor junior engineers and become a force multiplier by sharing your data experience with others in the engineering organization. 
At JupiterOne we see efficient data ingestion, storage, and processing as critical contributors to the success of our product. We require data engineers to follow software engineering best practices for code organization, quality control, and infrastructure management. We also encourage developing and maintaining experience across the full stack and value engineers who step outside of their comfort zone.

Key Qualifications:

• 5+ years of professional data engineering experience, particularly in big data processing for online systems
• Experience with SQL to query both structured and semi-structured data primarily stored in object storage
• Deep understanding of best modeling practices and partitioning/indexing strategies for data in object storage to achieve good read/write performance of distributed processing systems
• Experience with the AWS big data stack (S3, EMR, Athena, Glue) or a similar cloud-based offering
• Experience using modern parallel data processing frameworks (Presto/Trino, Spark) to work with TB-scale data
• Experience building production-quality data processing applications using Python, Java, or Scala
• Understanding of infrastructure as code
• Ability to communicate complex concepts clearly and accurately

Desired Qualifications:

• Experience with DevOps automation and infrastructure as code with tools like Terraform and CloudFormation
• Experience with modern data platforms like Databricks and Snowflake
• Experience with streaming technologies and frameworks (Apache Flink, Spark Streaming, Beam, Kinesis, Kafka)
• Experience with Lakehouse file formats and concepts (Delta Lake, Iceberg, Hudi)
• Experience deploying and maintaining modern orchestration tools like Airflow
• Exposure to multiple data store technologies, particularly DynamoDB, Redis, Elasticsearch, and Neptune
• Willing to explore new approaches to solving problems and challenging the status quo
• Bachelor’s degree in computer science or equivalent preferred

Data technologies we use:

• Python
• Scala
• Java
• AWS (EMR, S3, SQS/SNS, Lambda, Step Functions, Athena, Glue, Eventbridge, Kinesis)
• Apache Spark & Spark Streaming
• Spark SQL, Trino/Presto SQL, Databricks SQL
• Delta Lake
• Databricks
• DynamoDB

Other technologies used by our engineers:

• Node.js
• TypeScript
• React or similar (Vue, Angular, etc.)
• CSS, HTML, and JavaScript
• Build tools such as Webpack, Snowpack, Rollup, Next.js, and Gatsby
• Docker
• GraphQL
• Elasticsearch
• Redis
• Terraform
• Gremlin query language

JupiterOne's competitive compensation packages for salaried roles include: base salary, equity, variable/incentive pay, perks, and benefits. Cash compensation is determined by a variety of factors, to include job family, function, level, and geographic location, benchmarked against current market data. 
The target base salary range for this position is $120,000-$170,000
Final compensation packages are determined by multiple factors such as individual experience, education, qualifications, certifications, performance level, specialized expertise, and geographic location, and may vary from the target salary range listed above.
What we offer:
💰 Competitive Salary, plus Annual Bonus eligibility, plus Equity Options🩺 Medical & Rx Plans with Telemedicine, Mental Health Support, and Fertility Benefits (incl. domestic partners)🦷 Robust Dental and