Senior Security Architect, Nemo Microservices

NVIDIA is seeking a technical leader to define, craft, implement, review, advise, and guide implementation of secure architectures for NVIDIA’s Nemo microservices platform, a distributed architecture for customization, evaluation, and deployment of large language models (LLMs). A successful candidate will take a strong hands-on role, working with diverse teams across NVIDIA to define and meet security requirements for our innovative AI and ML projects. Our team is building next-generation services and interfaces for training and deploying AI at scale responsibly. We are dedicated to developing speech and NLP technologies that tackle real problems. We contribute to all steps of the machine learning lifecycle: from conceptualization, to applied research, engineering for optimized inference, and deployment.

What you'll be doing:

• Work with a multi-functional team of AI researchers, research engineers, and systems software engineers to design an enterprise microservice platform with strong security guarantees.

• Be forward thinking about security risks and codesign mitigations for safely using AI technology like LLMs for code generation and execution

• Be the internal expert on identifying, tracking, mitigating, and communicating risks unique to the use of AI/ML components in applications.

• Collaborate with NVIDIA's product security team to perform security assessments and establish the security roadmap across all components/applications in Nemo

• Participate in full development lifecycle, through requirements, proof-of-concepts, design, threat and vulnerability assessments, development, test, delivery, support, and maintenance of security services

• Identify, promote, and implement improvements to our engineering processes, documentation, tools, and generally improve our security posture for the organization.

• Provide technical support for high-urgency requests, within SLA, such as zero-day vulnerability resolutions

• Foster creative and collaborative atmosphere which will help your team members achieve outstanding results.

• Stay up to date on new tools & techniques in the information security and AI spaces.

What we need to see:

• MS or PhD in Information Security, Network Security, Cybersecurity, or a related field (or equivalent experience).

• 8+ years of proven experience in a combination of security and AI roles

• Great motivation, with strong interpersonal skills and the ability to communicate highly technical concepts to technical and non-technical audiences

• Experience in building end to end applications, infrastructure, and automation frameworks at large scale.

• Experience building distributed services with RESTful or other RPC APIs

• Background with container deployments & orchestration (Docker, Kubernetes)

• Experience deploying and managing distributed microservice architectures on cloud services (e.g. AWS, Azure, GCP)

Ways to Stand Out from the crowd:

• A desire to dive deep into technical details and understand how customer requirements translate into software modules

• Self-starter with the ability to break down complex problems into manageable tasks.

• Experience securing and protecting the AI components of AI powered applications.

The base salary range is 176,000 USD - 333,500 USD. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.

You will also be eligible for equity and benefits. NVIDIA accepts applications on an ongoing basis.

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.