Senior Systems Engineer – Observability (SSE)

JOB SUMMARY  

The Sr. Systems Engineer – Observability (SSE) role will define and implement infrastructure and application logging, setup governance, optimization, monitoring and controls for observability platform. The role will work with engineering, application and enterprise/solution architects to develop, implement and support logging, monitoring, reporting and automation for infrastructure and application services where applicable. This role serves as a subject matter expert in a complex array of full-stick solutions. This role serves as a subject matter expert performing research, analysis, design, creation, and implementation to meet current and future requirements across the enterprise. 

CANDIDATE PROFILE  

Education and Experience Required:  

Undergraduate degree in engineering or computer science discipline and/or equivalent experience/certification  

7+ years’ experience in information technology with hands-on technical/engineering roles including:  

5+ years’ admin experience Dynatrace/Grail/Splunk Cloud/Cribl, etc.  

3+ years’ experience in AWS cloud platforms log ingestion solutions  

3+ years data onboarding within a large-scale enterprise environment  

Experience in implementing and maintaining Dynatrace/Grail or other enterprise observability solutions. 

Experience in Dynatrace Query Language (DQL) and/or Splunk Processing Language (SPL) including building dashboards, reports and alerts to meet customer requirements. 

Experience in integrating observability tools with other ITOps solutions (Harness, ReadyAPI, ServiceNow, BigPanda, etc.)  

Additional Preferred Experiences:  

Dynatrace Certified Admin and/or Splunk Certified Admin  

Scripting experience in at least one of the following: PowerShell, Regex, Python, JavaScript, Ansible and Terraform. 

Strong knowledge of emerging tools, software, applications, and AI solutions for attaining best-in-class IT technology across the enterprise.  

Experience in building scalable pipelines for collecting, processing, and analyzing metrics, logs, and traces. 

Experience in establishing and implementing Observability best practices to standardize, monitor and control usage/performance of solutions.  

Excellent verbal and written communication skills for a wide range of audiences including executives, business stakeholders and IT teams  

Project planning and management experience.  

Experience operating in Scaled Agile Framework  

Demonstrated experience delivering technology solutions in a fast-paced, deadline driven enterprise environment. 

Demonstrated experience learning and applying new technologies to solve business needs 

Excellent problem-solving skills working independently and through leading outcomes for cross functional teams. 

Excellent understanding of change management, testing requirements, techniques, and tools to ensure high availability of systems  

Strong attention to detail with an ability to operate effectively across multiple priorities 

 

CORE WORK ACTIVITIES 

Design, implement, and maintain high-performance and scalable observability solutions for Kubernetes – EKS/ACK, ROSA, DocumentDB, EC2 and other data sources in a complex enterprise environment. 

Collaborate with cross-functional teams to gather requirements, architect solutions, and deploy logging and monitoring environments that align with business needs. 

Leverage in-depth knowledge of AWS, Azure and Alibaba Cloud technologies, including IaaS, PaaS, and SaaS, to architect and manage logging and monitoring tools’ deployments. 

Enable streamlined operational processes and efficient management of the Dynatrace infrastructure using scripting and automation. 

Responsible for infrastructure-as- code development and configuration management. 

Lead optimization efforts for observability platform and explore alternative solutions using other automation technologies like Cribl, etc. 

Onboard data sources from various IT infrastructure and app. components into observability tools (Dynatrace/Grail, Splunk,SignalFx, Cribl). 

Provide technical leadership, oversight, governance and direction for services related to Marriott solution delivery. 

Provide technical expertise to project team for successful project and change implementations 

Determine customer requirements and work with sourced resources to develop solutions 

Provide and present status, analysis and reporting to internal stakeholders, Executive Management and Senior Leadership. 

Lead analysis of current environment for deficiencies and provides solutions 

Identify opportunities to en