Senior Network Reliability Developer

We are seeking a skilled and proactive engineer with 3-5 years of experience to join our Network Reliability (NRE) team. The NRE team is our front-line for addressing physical network issues and operates 24x7x365 to ensure the reliability and efficiency of our physical network infrastructure. The team is responsible for performing data collection, triage, technical analysis, incident mitigation, and redirection as necessary to maintain and optimize operations.

Our primary objectives are: 

• Ensure maximum possible service availability and performance 
• Deliver premier customer service 
• Structured cabling knowledge with a highly critical eye for quality installation
• Datacenter construction knowledge
• Proficiency in using OTDR and other cable troubleshooting equipment, along with the capability to instruct and train engineers on their proper usage.

Provide comprehensive support to our Engineering and other Operational and technical teams 

These objectives translate into a broad and dynamic scope of responsibilities for the NRE team. Engineers will have the capability to centrally manage OCI’s networks and implement automated solutions to address common operational challenges efficiently.  

 

Note: This is a 24/7/365 position and includes day/night shift, weekend and holiday work with up to 25% travel to Abilene, TX based on business requirements. This position will also require consent to the processing of biometric data for identity verification and access control.

Career Level - IC3

Work with Site Reliability Engineering (SRE) team on the shared full stack ownership of a collection of services and/or technology areas. Understand the end-to-end configuration, technical dependencies, and overall behavioral characteristics of production services. Responsible for the design and delivery of the mission critical stack, with focus on security, resiliency, scale, and performance. Authority for end-to-end performance and operability. Partner with development teams in defining and implementing improvements in service architecture. Articulate technical characteristics of services and technology areas and guide Development Teams to engineer and add premier capabilities to the Oracle Cloud service portfolio. Understand and communicate the scale, capacity, security, performance attributes, and requirements of the service and technology stack. Demonstrate clear understanding of automation and orchestration principles. Act as ultimate escalation point for complex or critical issues that have not yet been documented as Standard Operating Procedures (SOPs). Utilize a deep understanding of service topology and their dependencies required to troubleshoot issues and define mitigations. Understand and explain the affect of product architecture decisions on distributed systems. Professional curiosity and a desire to a develop deep understanding of services and technologies.

 

NRE Operations 

• Using existing procedures and tooling, develop and safely complete network changes 
• Mentor, onboard and train junior engineers 
• Participate in operational rotations providing break-fix support  
• Identifying actionable incidents using monitoring systems, strong analytical problem-solving skills to mitigate network events/incidents, and following up on routine root cause analysis (RCA), coordinating with support teams and vendors 
• Provide on-call support services as needed, job duties are varied and complex, needing independent judgment 
• Join major event/incident calls, use technical and analytical skills to resolve network issues that impact Oracle customers/services 
• Fault handling and escalation - Identifying and responding to faults on OCI’s systems and networks, collaborating closely with 3rd party suppliers, handling escalation through to resolution 

Leadership: 

• Collaborates with the GNOC Shift Leads and management to ensure the efficient and timely completion of daily GNOC responsibilities 
• Takes the initiative to lead, contribute to and participate in the identification, development and evaluation of projects and tools aimed at enhancing the overall effectiveness of OCI.
• Develops and drives runbook audits and updates to ensure compliance and collaborate with partner service teams to ensure operational processes are aligned between teams  
• Conduct interviews and participate in the hiring process for junior level engineers 
• Lead and/or represent the GNOC in vendor meetings, reviews or governance boards 

Automations/Scripting 

• The role includes collaborating with networking automation services to integrate support tooling and frequently developing scripts to automate routine tasks 
• Preference for individuals with experienc