Sr. Systems Engineer – Observability

JOB SUMMARY

The Sr. Systems Engineer – Observability (SSE) role will define and implement infrastructure and application logging, setup governance, optimization, monitoring and control, including forecasting and chargeback model for observability platform. The role will work with engineering, application and enterprise/solution architects to develop and implement services, monitor, report and automation where applicable. This role serves as a subject matter expert in a complex array of full stack solutions. This role serves as a subject matter expert performing research, analysis, design, creation, and implementation to meet current and future requirements.  

 

CANDIDATE PROFILE

 

Education and Experience

 

Required:

• Undergraduate degree in an engineering or computer science discipline and/or equivalent experience/certification
• 7+ years’ experience in information technology with hands-on technical/engineering roles including: 
  • 5+ years’ admin experience Dynatrace/Grail/Splunk Cloud / Cribl, etc
  • 3+ Experience in AWS cloud platforms log ingestion solutions
  • 3+ years data onboarding within a large-scale enterprise environment
• Experience in implementing and maintaining Dynatrace/Grail or other observability solutions
• Experience in Dynatrace Query Language (DQL) and/or Splunk Processing Language (SPL) including building dashboards, reports and alerts to meet customer requirements.
• Experience in integrating observability tools with other ITOps solutions (Harness, ReadyAPI, ServiceNow, BigPanda, etc.)

 

Additional Preferred Experiences:

• Splunk Certified Admin and/or Dynatrace Certified Admin
• Scripting experience in at least one of the following: PowerShell, Regex, Python, JavaScript, Ansible and Terraform
• Strong knowledge of emerging tools, software, applications, and AI solutions for attaining best-in-class IT technology across the enterprise.
• Experience in researching emerging technologies and trends, standards, and products
• Experience in establishing and implementing Observability best practices to standardize, monitor and control usage/performance  of solutions.
• Excellent verbal and written communication skills for a wide range of audiences including executives, business stakeholders and IT teams
• Project planning and management experience.
• Experience operating in Scaled Agile Framework
• Demonstrated experience delivering technology solutions in a fast-paced, deadline driven enterprise environment 
• Demonstrated experience learning and applying new technologies to solve business needs
• Excellent problem-solving skills working independently and through leading outcomes for cross functional teams 
• Excellent understanding of change management, testing requirements, techniques, and tools to ensure high availability of systems
• Strong attention to detail with an ability to operate effectively across multiple priorities

 

CORE WORK ACTIVITIES

• Design, implement, and maintain high-performance and scalable observability solutions (Kubernetes – EKS/ACK, ROSA, DocumentDB and other data sources) in a complex enterprise environment.
• Collaborate with cross-functional teams to gather requirements, architect solutions, and deploy logging and monitoring environments that align with business needs.
• Leverage in-depth knowledge of AWS, Azure and Alibaba Cloud technologies, including IaaS, PaaS, and SaaS, to architect and manage logging and monitoring tools’ deployments.
• Demonstrate proficiency in scripting and automation, enabling streamlined operational processes and efficient management of the Dynatrace and Splunk infrastructure.
• Lead optimization efforts for observability platform and explore alternative solutions using other automation technologies like Cribl, etc.
• Onboard data sources from various IT infrastructure and app. components into observability tools (Dynatrace/Grail, Splunk,SignalFx, Cribl).
• Provides technical leadership, oversight, governance and direction for services related to Marriott solution delivery
• Provides technical expertise to project team for successful project and change implementations
• Determines customer requirements and works with sourced resources to develop solutions 
• Provides and presents status, analysis and reporting to internal stakeholders, Executive Management and Senior Leadership
• Leads analysis of current environment for deficiencies and provides solutions
• Identifies opportunities to enhance the service delivery, operations and continual service improvement processes
• Responsible for p