Staff Engineer - Data Reliability Engineering (REMOTE)

Staff Engineer - Data Reliability Engineering

Position Summary

We are seeking a highly experienced Staff Engineer for Data Reliability Engineering to join our dynamic team. In this role, you will lead the design and implementation of large-scale, modern data platforms with a strong focus on reliability, scalability, and performance. As a key technical leader, you will leverage Open-Source technologies and work with major cloud platforms or large-scale private data centers to ensure our data infrastructure meets the highest standards for availability, security, and efficiency.

Position Description

You will collaborate closely with data engineers, software developers, SREs, and stakeholders across the organization to build systems that provide robust data processing pipelines, monitoring solutions, and automated incident responses, ensuring continuous data integrity and reliability.

Position Responsibilities:

• Lead the design and implementation of large-scale, fault-tolerant, and highly available data platforms.

• Architect and develop end-to-end data pipelines that ensure the reliability, scalability, and performance of data processing systems.

• Drive best practices for data reliability, disaster recovery, monitoring, alerting, and incident management.

• Collaborate with cross-functional teams (data engineering, DevOps, SREs) to integrate, test, and improve platform reliability and performance.

• Mentor and guide engineers across the organization, promoting a culture of engineering excellence and continuous improvement.

• Leverage open-source tools and technologies to enhance platform capabilities, reduce costs, and increase flexibility.

• Implement automation strategies for system monitoring, data quality checks, failure recovery, and incident resolution.

• Optimize performance and cost efficiency across data infrastructures hosted on major cloud providers (AWS, GCP, Azure) or large-scale private data centers.

• Establish and enforce security and compliance standards for data systems.

Qualifications:

• Expertise in designing and managing large-scale distributed data systems.

• Strong knowledge of modern data platforms (e.g. Snowflake, Spark, Kyuubi, Datalake, Kafka, Airbyte, Trino, Flink, Azure Data Factory, Nifi) and related open-source tools.

• Hands-on experience with major cloud platforms (Azure, AWS, GCP) or large-scale private data center environments.

• Proficiency in programming and scripting (Python, Java, Scala, Go, etc.) for automation, data processing, and systems engineering.

• In-depth knowledge of CI/CD practices, containerization (Docker, Kubernetes), and infrastructure-as-code (Terraform, Ansible, Puppet, Chef).

• Strong understanding of database technologies (SQL, NoSQL) and distributed computing frameworks.

• Experience with monitoring, alerting, and troubleshooting tools (Prometheus, Grafana, Log Analytics, Datadog, etc.).

• Proven ability to mentor engineers and lead technical initiatives across teams.

• Excellent communication skills and ability to work effectively in a fast-paced, cross-functional environment.

Preferred Qualifications:

• Experience with streaming technologies such as Apache Kafka, Flink, or Spark Streaming.

• Expertise in data governance, security, and compliance within large-scale data systems.

• Prior experience in disaster recovery planning and execution.

• Familiarity with machine learning pipelines and advanced analytics platforms.

Experience:

• 8+ years of experience in Data Engineering, Site Reliability Engineering (SRE), or Software Engineering roles with a focus on data platforms.

• 8+ years of professional experience in data software development, programming languages and developing with big data technologies

• 5+ years of experience with architecture and design

• 5+ years of experience with AWS, GCP, Azure, or another cloud service

• 4+ years of experience on open-source development

Education

• Bachelor’s Degree in Computer Science, Information Systems, or equivalent education or work experience.

#LI-TK1

 

Annual Salary

$115,000.00 - $230,000.00

The above annual salary range is a general guideline. Multiple factors are taken into consideration to arrive at the final hourly rate/ annual salary to be offered to the selected candidate. Factors include, but are not limited to, the scope and responsibiliti