Staff Software Engineer - Security Chaos Engineering

The Observability Infrastructure SRE Team is part of the Core Observability SRE group and the SRE/Security organization overall. Core Observability is a group focused on managing Datadog's internal observability tooling and practices, which includes using a variety of Datadog products. The group is focused on observability's adoption and efficiency throughout Datadog's organization, as it is a key aspect of an effective SRE approach for engineers to build and operate systems more effectively.

The Observability Infrastructure team owns the Datadog telemetry data plane, collecting large volumes of observability data (such as metrics, logs, traces but also various security-related data types) across all Datadog environments. This newly formed team focuses on the performance and scalability of that pipeline in a multi-region, multi-cloud provider ecosystem. In this pipeline, they work on libraries, fleet of agents, data processors and endpoints, partnering closely with the engineering teams who are building these components. We routinely work together on testing or building new functionality, improving the product for both Datadog internally and our customers.

As an Engineering Manager, you'll help build this team from the ground up—defining its mission, hiring engineers, and delivering key projects. The team will own critical observability systems to ensure scalability, reliability, and efficiency across Datadog. We aim to integrate the latest Datadog features, drive product innovation, and maintain operational excellence.

At Datadog, we place value in our office culture - the relationships and collaboration it builds and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them.

What You’ll Do:

• Lead and mentor a team of experienced SWEs around the globe who are passionate about building a culture of reliability, observability and security at Datadog. Help engineers grow to the next level and continuously provide them opportunities to develop. 
• Solve Datadog specific observability, instrumentation or telemetry collection problems, by designing and implementing internal solutions or contributing to our products.
• Build, scale and operate a robust telemetry data plane, processing a large amount of data with strict performance and reliability objectives.
• Work in partnership with our product teams to leverage new features and influence direction.
• Work hand in hand with our infrastructure team to design an architecture for all of Datadog environments, across many different cloud providers, regions of the world, or technology stacks. Support the scale and growth of Datadog in all of these dimensions.
• Gather requirements for operational usecases with the relevant stakeholders (developers, infrastructure teams, on-call/incident response, security investigations and incidents, compliance, …) and work on implementing relevant supporting telemetry collection, processing and configuration. Our shared goal is a stronger resiliency and security posture.

Who You Are:

• 2-3 years experience as a people manager or as a technical leader with strong mentorship skills. Ideally candidates will have experience in career development, performance management, tracking and optimizing team velocity, sprint planning, OKRs, and hiring.
• 2-3 years experience in SRE and Observability, specifically hands-on experience with Observability concepts & technologies and operating an observability platform or tool at scale for other engineers. More specifically technical experience with metrics, tracing or logging in large-scale distributed systems, Kubernetes and cloud-based infrastructure.
• Strong stakeholder management skills. This will involve using your empathy, collaboration, and communication skills in English to work remotely with people across teams. Because our projects touch lots of different parts of the business, we frequently collaborate with stakeholders across Datadog and need to motivate teams to work together towards a shared goal.

Datadog values people from all walks of life. We understand not everyone will meet all the above qualifications on day one. That's okay. If you’re passionate about technology and want to grow your skills, we encourage you to apply. 

Benefits and Growth: 

• New hire stock equity (RSUs) and employee stock purchase plan (ESPP)
• Continuous professional development, product training, and career pathing
• Intradepartmental mentor and buddy program for in-house networking
• An inclusive company culture, ability to join our Community Guilds (Datadog employee resource groups)
• Access to Inclusion Talks, our Internal panel discussions
<