Senior Research Engineer - Inference, Strategic AI

We are seeking a Research Engineer to join our strategic AI team, which is responsible for informing the roadmap of our future hardware and software stack. If you are a research/software engineer who enjoys working at the forefront of Generative AI, is passionate about fast-evolving Large Language models, and is driven to unite the latest AI research and future hardware designs in a cohesive, full-stack software strategy, we should talk!

We contribute to all steps of the machine learning lifecycle: from conceptualization to applied research, engineering for optimized inference, training and deployment. As a research engineer on the team, you will interact with both internal teams, and key strategic partners to surface, define and help implement the inference strategy of our products.

What you will be doing:

• Working closely with our most strategic partners and researchers to surface areas that stretch our hardware and software in unique ways.

• May include quick prototyping, architecting and crafting new features.

• Working with engineering, research and product teams across all of NVIDIA to ensure flawless transition of concepts to the NVIDIA stack.

• Conceptualize a solution across multiple facets - data center designs, networking, different model architectures, NVIDIA stack and deployment scenarios.

What we need to see:

• Doctoral degree in Computer Science, Computer Engineering, related field (or equivalent experience)

• 5+ years proven experience in Deep Learning frameworks and NVIDIA GPUs.

• Excellent C/C++, Python programming and software design skills, including debugging, performance analysis, and test design.

• Experience in the fields of sparsity, quantization and inference.

• Understanding of the latest techniques in Deep Neural Networks.

• Strong communication and interpersonal skills along with the ability to work in a dynamic and distributed team.

• Ability to think beyond what's possible right now.

Ways to stand out from a crowd:

• Experience with the following technologies is a huge plus: code generation and graph compiler technologies such as TVM, MLIR, XLA etc.

• Knowledge of CPU and GPU architecture

• GPU programming (CUDA)

With competitive salaries and a generous benefits package, we are widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us and, due to unprecedented growth, our exclusive engineering teams are rapidly growing. If you're a creative and autonomous engineer with a real passion for technology, we want to hear from you.

The base salary range is 180,000 USD - 333,500 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.