HPC Storage Systems Engineer, Clusters Group (Hybrid Eligible)

Requisition Id 10213 

Overview:

The National Center for Computational Sciences (NCCS) at Oak Ridge National Lab (ORNL), which hosts several of the world’s most powerful computer systems, is seeking highly qualified individuals to play a key role in improving the security, performance, and reliability of the NCCS computing environments.  

 

In this role, you will work within the HPC Clusters Group inside of the NCCS Systems Section to support numerous activities of the center.

 

Our administers and supports the division’s HPC computing infrastructure, which includes system installation, deployment, acceptance, performance testing, upgrades, problem diagnosis, and troubleshooting.

 

This position is part of the HPC Systems Section which administers and supports the division’s computing, networking, and storage systems.

Our division, National Center for Computational Sciences (NCCS), provides state-of-the-art computational and data science infrastructure, coupled with dedicated technical and scientific professionals, to accelerate scientific discovery and engineering advances across a broad range of disciplines. NCCS hosts the Oak Ridge Leadership Computing Facility, one of DOE’s National User Facilities.

 

Major Duties/Responsibilities:

• The application of systems analysis techniques and procedures, including consulting with users/customers, to determine hardware, software or system functional specifications
• The design, development, documentation, analysis, creation, testing, optimization, or modification of computer systems or programs, including prototypes, based on and related to user or system design specifications
• The design, documentation, testing, automation, creation, or modification of computer programs or complex tasks related to machine operations
• Work with the team to define and implement best practices and standards within the organization
• Diagnose system operational problems quickly and effectively
• Participate in an on-call rotation providing 24-hour, 7-day support and off-hours maintenance windows
• Coordinate with vendors to resolve hardware and software problems
• Ability to lead storage-related projects with internal and external representatives
• Act as subject matter expert for storage resources for various projects
• Lead system design, facility integration, deployment, upgrades, issues resolution, and decommissioning

 

Basic Qualifications:

• Bachelor’s Degree in computer science or closely related field.
• 5+ years of experience managing Linux/UNIX operating systems in a heterogeneous environment.
• An equivalent combination of education and experience will be considered.

 

Preferred Qualifications:

• Excellent interpersonal/communication skills, and the ability to work as part of a team
• Working knowledge of Linux system fundamentals and common network protocols and technologies like TCP/IP, InfiniBand, and Fiber-channel
• Understanding of networked computing environment concepts
• Ability to develop and maintain programs and scripts that aid in the operation and automation of administrative tasks using various shell and scripting languages.
• Ability to identify requirements and to define, plan, and implement requisite solutions
• Ability to plan, organize, prioritize tasks, and complete assigned projects with minimal supervision
• Experience with continuous integration and continuous deployment software methodologies and how they apply to systems engineering.
• An understanding of code review and familiarity with tools like GitHub and GitLab.
• Experience using tools such as Grafana and Nagios to monitor systems, metrics, create custom checks, and create dashboards.
• Experience with stateless operating system technologies, concepts, and rollout
• Experience participating in an open source community with patches accepted upstream.
• Experience deploying and maintaining automated configuration management software such as Puppet.
• Experience building custom packages for RHEL/CentOS using RPM.
• Experience in common RAID schemes
• Experience with ZFS
• Experience in storage benchmarking fundamentals and associated tools.
• Ability to provide dedicated mentorship on diverse, complex, and abstract concepts
• Experience with HPC parallel storage solutions like Lustre, GPFS, etc.

 

Special Requirement:

This position requires the ability to obtain and maintain a clearance from the Department of Energy. As such, this position is a Workplace Substance Abuse program (WSAP) testing designed position which requires passing a pre-placement drug test and participation in an ongoing random drug testing p