Machine Learning Systems Engineer, Staff - XR Labs

Qualcomm XR Labs in San Diego is expanding our perception team focusing on Smartglasses and XR (AR/VR/MR) solutions and driving low-power SoCs for personal AI and XR devices. We develop integrated, multi-modal DL systems to deliver ultra-optimized, power-efficient software and hardware to enable the intelligent perception of the world around us. 

Candidates bring a deep understanding of engineering pipelines and solutions of computer vision and machine learning algorithms and technologies that are necessary for interactive, real-time, and immersive systems, including state-of-the-art Multimodal Deep-learning methods combining Audio, Video, User Interaction & Personalization. They preferably have experience in systems design and implementations for real-time embedded and mobile platforms. 

Job description / responsibilities 

As an individual contributor you will have the following responsibilities. 

• Quickly understand latest academic and state-of-the-art algorithms on Multimodal LLMs, VLMs and related systems, prototyping on desktop and migrating to Qualcomm SoCs. 

• Technical leadership in designing, prototyping, and optimizing systems for Smartglasses and XR devices. 

• Understand Smartglasses and XR use-cases and concurrency constraints to drive multi-modal network architectures for combined processing to achieve minimal power consumption. 

• Communication with use-case stakeholders, customers, tech teams, and HW design teams to ensure optimal architectures for low-power features. 

Key Experience Areas 

• Hands-on development of deep learning models (PyTorch/TensorFlow) and practical ML pipelines.   

• Hands-on experience with Multimodal LLMs and VLM systems, including data curation, training, deployment, and optimization. 

• Experience in Multimodal ML including Audio, Speech, Video, User Input, and Personalization.  

• Strong coding skills in Python and C++ for production and on-device implementation. 

• Experience wi