Sr. Staff ML Engineer, Hardware Software Co-Design

Rivian
Palo Alto, CA, United States
2 months ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Working hours
Regular working hours
Job source

Tech stack

Artificial Intelligence Computer Vision C++ (Programming Language) Code Generation Nvidia CUDA Computer Engineering Software Debugging Python (Programming Language) Object Detection OpenCL Tensorflow Pytorch
+6 more
Large Language Models Deep Learning Information Technology ONNX (Open Neural Network Exchange) Format Hardware Acceleration Machine Learning Operations

Job description

We are looking for an Engineer / Research Scientist with deep expertise in quantized deep learning models for hardware acceleration in autonomous systems. In this cross-disciplinary role, you will bridge perception model design and hardware-aware deployment, enabling efficient execution of high-performance perception algorithms across embedded compute platforms. You will focus on researching state of the art perception models and develop optimization pipelines for the quantized versions of these models customized to provide real-time performance and energy efficiency on next-generation autonomy hardware.

  • Research state of the art perception models in collaboration with the ADAS SW teams
  • Lead the development of optimizations for mapping quantized perception models (e.g., CNNs, Transformers, LLMs) to embedded and heterogeneous hardware platforms.
  • Design and implement hardware-aware optimizations, including quantization strategies, model compression, memory-efficient representations, and operator fusion, targeted to custom accelerators.
  • Collaborate with hardware teams to co-optimize model architecture and compute pipeline under real-time constraints (latency, throughput, power).
  • Benchmark and analyze system performance across platforms and iterate to achieve optimal deployment efficiency.
  • Partner with perception, systems, and autonomy teams to align model optimization efforts with hardware roadmap and real-world autonomy requirements.

Requirements

Do you have experience in System deployment?, * Ph.D. or M.S. in Computer Engineering, Electrical Engineering, Computer Science, or related field with a focus on ML compilers, embedded systems, or hardware-aware AI.

  • Hands-on experience with quantized model deployment, ML design stacks, and code generation for embedded or heterogeneous compute systems.
  • Strong understanding of computer vision models (e.g., object detection, segmentation) and their optimization for edge inference.
  • Proficiency in deep learning frameworks (e.g., PyTorch, TensorFlow) and their low-level IRs or export formats (e.g., ONNX).
  • Solid programming skills in C++, Python Familiarity with CUDA/OpenCL (or other accelerator programming models)., * Prior experience working with hardware-software co-design, especially for autonomous or robotics platforms.
  • Deep knowledge of numerical precision trade-offs, quantization-aware training (QAT), and dynamic/static quantization flows
  • Familiarity with embedded real-time constraints and hardware profiling/debugging tools.
  • Familiarity with rearchitecting models to best suit hardware capabilities.
  • Publication record in top-tier ML/Systems conferences (e.g., MLSys, NeurIPS, DAC, ICCAD).

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on indeed.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

1:19 min

Advancing autonomous driving capabilities with specialized software talent

Katrin Lehmann Katrin Lehmann +1 · Coffee With Developers

1:39 min

Fundamentals of tensors and the TensorFlow library

Håkan Silfvernagel · LIVE

1:42 min

Navigating emerging hardware standardization in vendor programming ecosystems

Paul Graham Paul Graham · LIVE

2:35 min

Preventing remote code execution in PyTorch models

Balázs Kiss · WWC 2023

3:51 min

Technical skills and collaborative mindsets for mobility engineering roles

Georg Kühberger +1 · LIVE

3:55 min

Evaluating central server APIs against edge deployment models

Hauke Brammer · WWC 2021

Videos

See all

Related articles

See all