Sr. Observability Systems Engineer
Backblaze External WebsiteAbout the role
<p><strong>Role Overview</strong></p> <p>This is a senior individual contributor role with significant architectural ownership. You will set the technical direction for how Backblaze detects, correlates, and responds to infrastructure incidents across our data centers, and you will mentor other engineers on the team as that platform matures. If you have a passion for making complex distributed systems visible, you are comfortable making architecture decisions that will outlive your tenure, and you are excited about applying AI and agentic automation to infrastructure operations, this role was built for you..</p> <p><strong>Key Responsibilities</strong></p> <p><strong>Technical Leadership</strong></p> <ul> <li>Set technical direction and standards for observability across the organization, including instrumentation conventions, alerting philosophy, and dashboard design patterns.</li> <li>Mentor engineers on the Observability team and act as a technical resource for SRE, Storage Engineering, and Network Engineering on observability practice.</li> <li>Lead design reviews for observability work and represent the team in cross-functional architecture discussions.</li> <li>Evaluate build-versus-buy decisions for observability and AIOps tooling, including data sovereignty and compliance considerations.</li> <li>Produce and maintain design documentation, runbooks, and architectural decision records that make the platform operable and extensible by future contributors.</li> </ul> <p><strong>Observability Platform</strong></p> <ul> <li>Own and evolve our metrics pipeline, including VictoriaMetrics, Prometheus, and the Consul-based service discovery layer that keeps scrape targets current as infrastructure scales.</li> <li>Own and expand our logging stack (OpenSearch, Logstash, and Filebeat) across all Backblaze data centers.</li> <li>Architect and expand distributed tracing with Jaeger and OpenTelemetry, extending coverage beyond the current application instrumentation to new services.</li> <li>Define and maintain Grafana dashboard standards for infrastructure, storage, and application performance visibility.</li> <li>Drive expansion of internal application telemetry in partnership with application teams to improve visibility.</li> <li>Define capacity and retention strategy for the telemetry stack as the fleet grows.</li> </ul> <p><strong>Infrastructure & Automation</strong></p> <ul> <li>Own infrastructure-as-code for observability stack deployments across multiple Kubernetes clusters.</li> <li>Write and review automated playbooks for configuration management and automation across Debian-based bare metal servers.</li> <li>Partner
Apply for this role
Generate a tailored application kit with a matched cover letter, interview prep, and CV highlights — in under 60 seconds.
Apply Now →Generate Application KitFree account required — sign up in 30s