Hardware Systems Engineer, NPI AI Lead

Meta is seeking a Systems Engineer to join our Release to Production (RTP) team working on AI/ML initiatives supporting large scale AI Training and Inference. Our servers and data centers are the foundation upon which our rapidly scaling infrastructure operates efficiently to deliver our innovative services. The RTP team is responsible for the end-to-end Hardware Lifecycle of all Meta servers including prototyping of experimental HW, pre-production hands-on system validation and hardware debugging, enabling production-ready system monitoring, automated provisioning and automated remediation of issues. RTP team also helps in exploring, developing and productizing high-performance software and hardware technologies for AI at datacenter scale.

RTP Engineers work closely with HW/SW co-design teams, hardware designers, networking teams, system manufacturers, component vendors, capacity engineering, production engineering, production services, and data center operations teams to enable new systems that will be deployed in our production data centers.

Ramping to production and solving the datacenter scaling and deployment challenges requires us to take a systems based approach to hyperscalar bring up and validation.Hardware Systems Engineer, NPI AI Lead Responsibilities

• Lead the bring-up, validation, and deployment of cutting-edge hardware systems in lab and datacenter environments.
• Lead and drive with direct contribution to end-to-end system validation (hardware and software), with a focus on datacenter applications.
• Utilize experience in accelerator and network architecture, AI workloads/ML models to design and implement robust system-level test plans, including functional, stress, and performance tests.
• Develop and execute validation plans aligned with production system use cases, creating and automating corresponding test cases.
• Design experiments and develop tools to detect, diagnose, and monitor system hardware/network/silicon/firmware/software health issues.
• Enhance hardware reliability by creating data visualizations and implementing systemic solutions to address recurring health issues.
• Communicate complex technical findings and recommendations to broad audiences, including technical and non-technical stakeholders at all levels.

Minimum Qualifications

• Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience
• 4+ years of experience in direct expertise troubleshooting and debugging HW systems through production cycles, including compute, interconnect, or GPU servers.
• Expertise debugging several domains, including PCIe, serdes, networking/interconnect, flash, memory, CPU, GPU, or DRAM (DDR4/5 or HBM).
• Expertise in Python, C/C++ and/or similar languages, within a Linux environment, for server system management, automation, version control, CI/CD, or similar.
• 4+ years of direct experience with developing test cases/plans/specifications, root-causing error codes, failure analysis, and engineering solutions through system troubleshooting and debugging (performance, characterization, integration, FW, or similar).
• Experience as a team lead or significant contributor/owner of wide-reaching debug projects.

Preferred Qualifications

• 5+ years of experience supporting AI/HPC system architecture at rack level and at scale, as well as debugging AI/HPC systems, performance optimizations, including familiarity with relevant tools, libraries, and frameworks (e.g., NCCL, PyTorch, CUDA)
• 5+ years of expertise with lab debugging tools (oscilloscopes, protocol analyzers, and traffic generators) and SoC debugging tools (e.g., JTAG, GDB, Trace32) for testing and debugging.
• 3+ years of experience supporting complex chipsets, including functional, stress, and performance testing and validation with focus on automation.
• 3+ years of direct experience in supporting and building systems/products for datacenter applications such as telemetry, video processing, AI/ML, and networking.

For those who live in or expect to work from California if hired for this position, please click here for additional information. About Meta Meta builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps like Messenger, Instagram and WhatsApp further empowered billions around the world. Now,