Machine Learning Systems Engineer, Staff - XR Labs

Qualcomm
San Diego, CA, United States
3 months ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Compensation
$158,400.0 - $237,600.0
Working hours
Regular working hours
Job source

Tech stack

Systems Engineering Computer Vision C++ (Programming Language) Profiling Information Systems Computer Engineering Human-Computer Interaction Python (Programming Language) Machine Learning Network Architecture Object-Oriented Software Development Tensorflow
+8 more
Software Engineering Pytorch Large Language Models Virtual Reality Deep Learning Information Technology Machine Learning Operations Software Coding

Job description

Candidates bring a deep understanding of engineering pipelines and solutions of computer vision and machine learning algorithms and technologies that are necessary for interactive, real-time, and immersive systems, including state - of - the - art M ultimodal Deep-learning methods combining Audio, Video, User Interaction & Personalization . They preferably have experience in systems design and implementations for real-time embedded and mobile platforms .

Job description / responsibilities

As an individual contributor you will have the following responsibilities.

  • Quickly understand latest academic and state-of-the-art algorithms on Multimodal LLMs, VLMs and related systems, prototyping on desktop and migrating to Qualcomm S o Cs.

  • Technical leadership in d esign ing , prototyp ing , and optimiz ing systems for Smartglasses and XR devices .

  • Understand Smartglasses and XR use-cases and concurrency constraints to drive multi-modal network architectures for combined processing to achieve minimal power consumption.

  • Communication with use-case stakeholders, customers, tech teams, and HW design teams to ensure optimal architectures for low-power features.

Requirements

  • Hands-on development of deep learning models ( PyTorch /TensorFlow) and practical ML pipelines .

  • Hands-on experience with M ultimodal LLM s and VLM systems , including data curation, training , deployment, and optimization.

  • Experience in Multimodal ML including Audio, Speech, Video, User Input, and Personalization.

  • Strong coding skills in Python and C++ for production and on-device implementation.

  • Experience with on-device optimization (quantization, acceleration, profiling) on mobile or embedded platforms.

Preferred Experience

  • Experience with Smartglasses and Augmented/Virtual Reality devices and applications

  • Experience in development, incl. testing and debugging on XR devices, mobile platforms or other embedded systems

  • Strong C++ skills with solid object - oriented design principles

  • Real-time c omputer graphics, * Bachelor’s degree in Computer Science, Engineering, Information Systems, or related field and 4+ years of Hardware Engineering, Software Engineering, Systems Engineering, or related work experience., Master’s degree in Computer Science, Engineering, Information Systems, or related field and 3+ years of Hardware Engineering, Software Engineering, Systems Engineering, or related work experience. OR PhD in Computer Science, Engineering, Information Systems, or related field and 2+ years of Hardware Engineering, Software Engineering, Systems Engineering, or related work experience.

Benefits & conditions

The above pay scale reflects the broad, minimum to maximum, pay scale for this job code for the location for which it has been posted. Even more importantly, please note that salary is only one component of total compensation at Qualcomm. We also offer a competitive annual discretionary bonus program and opportunity for annual RSU grants (employees on sales-incentive plans are not eligible for our annual bonus). In addition, our highly competitive benefits package is designed to support your success at work, at home, and at play. Your recruiter will be happy to discuss all that Qualcomm has to offer - and you can review more details about our US benefits at this link .

About the company

Qualcomm Technologies, Inc., Qualcomm XR Labs in San Diego is expanding our perception team focusing on Smartglass es and XR (AR/VR/MR) solutions and driv ing low-power SoCs for personal AI and XR devices. We develop integrated, multi-modal DL system s to deliver ultra-optimized, power-efficient software and hardware to enable the intelligent perception of the world around us., Qualcomm expects its employees to abide by all applicable policies and procedures, including but not limited to security and other requirements regarding protection of Company confidential information and other confidential and/or proprietary information, to the extent those requirements are permissible under applicable law.

Pay range and Other Compensation & Benefits : $158,400.00 - $237,600.00

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on indeed.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:35 min

Preventing remote code execution in PyTorch models

Balázs Kiss · WWC 2023

47 sec

Profiling native execution calls with async-profiler

Gonzalo Ortiz Jaureguizar Gonzalo Ortiz Jaureguizar · WWC Europe 2026

1:39 min

Fundamentals of tensors and the TensorFlow library

Håkan Silfvernagel · LIVE

2:07 min

Headset recommendations and upcoming XR hardware releases

rafek rafek · WWC 2024

4:41 min

Replacing PyTorch with ONNX runtime for AWS Lambda deployments

Marek Suppa · LIVE

3:51 min

Technical skills and collaborative mindsets for mobility engineering roles

Georg Kühberger +1 · LIVE

Videos

See all

Related articles

See all