Principal Software Engineer

About the Job

Red Hat’s Emerging Technologies group is seeking a Principal Software Engineer to join our growing team focused on the upstream enablement of our AI Core Platform, defined as the intersection of PyTorch, FSDP, vLLM and Triton. Initially the team will be focused on GPU kernels that are leveraging Triton and how those kernels support our most strategic accelerator partners (NVIDIA, AMD and Intel at present) and how effectively those kernels are working in both PyTorch and vLLM. The team will add emerging technologies to the ecosystem around this stack as the opportunities/problems become apparent.

In this role, you will work with a diverse team of highly motivated engineers on designing, implementing, and integrating AI Core Platform capabilities and contribute directly to upstream communities such as PyTorch, FSDP, vLLM and Triton, and others.

You will work closely with product engineering groups within Red Hat focused on integrating and delivering enterprise-ready software that’s hardened, tested, and securely distributed with our AI/MLOps platforms.  

You will collaborate with your Open Source Program Office(OSPO) to make sure the technology strategy informs the community strategy and vice versa. Collaborating on related events, conferences, community meetings and foundation/project governance topics.                                                                  

What you will do

• Develop and maintain a high-quality, high-performing AI Core platform open source upstream stack enabling Red Hat AI/MLOps platforms offerings  

• Maintain CI/CD build pipelines for container images that allow faster, more secure, reliable, and frequent releases

• Contribute directly to upstream runtime communities such as PyTorch, FSDP, vLLM, Triton, and others.

• Consistently participate and take leadership opportunities in community meetings and foundation/project governance topics.

• Share upstream contributions at events, conferences and via technical blogs and publications 

• Coordinate and communication with various Red Hat product and open source stakeholders

• Applying a growth mindset by staying up-to-date on the latest advancements in AI frameworks, hardware accelerators, and ML advancements

What you will bring

• Highly experienced with programming in Python and PyTorch

• Experience with hardware accelerators (e.g., GPUs, FPGAs) for AI workloads

• Experience with Python packaging such as PyPI libraries

• Development experience with C++ and CUDA APIs is a big plus

• Solid understanding of the fundamentals of model training and inferencing architectures

• Experience with Git, shell scripting, and related technologies

• Experience with the development of containerized applications in Kubernetes

• Experience with Cloud Computing using at least one of the following Cloud infrastructures AWS, GCP, Azure, or IBM Cloud

• Ability to work across a large distributed hybrid engineering team 

Following is considered a plus

• Experience with open-source development is a plus

​

#LI-MD2

The salary range for this position is $163,420.00 - $269,640.00. Actual offer will be based on your qualifications.

Pay Transparency

Red Hat determines compensation based on several factors including but not limited to job location, experience, applicable skills and training, external market value, and internal pay equity. Annual salary is one component of Red Hat’s compensation package. This position may also be eligible for bonus, commission, and/or equity. For positions with Remote-US locations, the actual salary range for the position may differ based on location but will be commensurate with job duties and relevant work experience. 

About Red Hat

Red Hat is the world’s leading provider of enterprise open source software solutions, using a community-powered approach to deliver high-performing Linux, cloud, container, and Kubernetes technologies. Spread across 40+ countries, our associates work flexibly across work environments, from in-office, to