Principal Site Reliability Engineer

The Principal Site Reliability Engineer (Principal SRE) plays a pivotal role in ensuring the seamless and reliable operation of an organization's digital infrastructure. This highly technical position will enhance the performance, scalability and reliability of the organization's complex systems and applications. It will reduce time to detect and restore systems, increase uptime and improve incident response by utilizing best practices in automation, monitoring, and incident management. This role requires a deep understanding of Cloud technologies, Distributed Systems, Automation / Scripting, Observability, Software Engineering, DevOps, and will take a proactive approach to preventing and mitigating potential issues. This role will report to the Director of Site Reliability Engineering, and will help foster a culture of innovation, continuous improvement, and collaboration within the team to meet the organization's evolving needs and deliver a superior digital experience to users.

This is a Remote position available in the United States. 

Bright Horizons is trusted by families and employers around the world for high-quality childcare and early education, back-up care, and workplace education. We partner with some of the world’s best companies to provide services that help employees perform their best and support families to thrive both personally and professionally.  

Responsibilities

• Reliability and Scalability: Contribute significantly to the reliability, scalability and availability of Bright Horizons' digital infrastructure by enforcing best practices of redundancy and resiliency across applications and infrastructure.

• Observability: Implement robust infrastructure, application and digital-experience monitoring in our enterprise-wide APM tool Dynatrace. Proactively identify potential issues, analyze system performance, and facilitate quick response to incidents. Create dashboards, alerts and automated workflows that can be utilized by other Operations or Application teams.

• Incident Management: Drive troubleshooting of critical incidents through developing a deep and broad understanding of our enterprise architecture across all 7 OSI layers. Utilize monitoring and alerting to ensure timely incident resolution. Track KPIs like MTTD/MTTR and identify short-term and medium-term opportunities to improve. Conduct post-mortems to identify root cause and implement preventive measures.

• Automation and Efficiency: Drive the development and implementation of automation solutions to streamline processes, reduce manual interventions, and enhance the overall efficiency of the Product, Engineering and SRE teams.

• Tools Ownership: Besides owning Observability tools, create a roadmap to expand and consolidate. This should provide a 360-degree view of cross-functional areas like SRE, DevOps, Application Support, Monitoring, Incident Management, Infrastructure and Enterprise Architecture.

• Collaboration: Collaborate with the above cross-functional teams to drive a unified approach to site reliability that optimizes their work and improves time-to-market for all respective objectives. Foster strong relationships with these delivery organizations to implement an SRE culture that delivers organizational goals.

• Infrastructure Roadmap and System Capacity Planning: Work closely with Infrastructure and Architecture teams to design and implement roadmaps for scaling server and serverless architecture using Containers as well as IaC tools like Ansible, Terraform etc. Conduct disaster recovery and controlled failure testing to improve resiliency. Conduct capacity planning to handle current and future demand.

Minimum Requirements

• Bachelor’s degree in Computer Science, Engineering, or related field - Required 

• A minimum of 10 years of experience, including at least 5 years in the SRE field, with a proven track record of progressively increasing responsibilities - Required

Additional Job Requirements

• Master’s degree in Computer Science, Engineering, or related field - Preferred

• Demonstrated ability to work with cross-functional Development, QE and Operations teams to understand the underlying architecture, and help improve its reliability and scalability.

• Strong understanding and experience in automation tools and programming/scripting languages (e.g., PowerShell, Python, Bash) to deliver improvements at a small and large scale.