Senior Runtime Engineer - AI Accelerator

Darwin
San Jose, CA, United States
14 days ago
Apply on www.careerbuilder.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Compensation
$230,000 - $275,000
Working hours
Regular working hours

Tech stack

Artificial Intelligence C++ (Programming Language) Computer Programming Memory Management Tensorflow Graphics Processing Unit (GPU) Application Specific Integrated Circuits Pytorch

Job description

You will own the software layer between ML frameworks and the accelerator hardware: the runtime that loads models, manages memory and schedules work across chips.

Working with compiler, kernel and hardware teams, you will decide how much of the silicon’s performance reaches real workloads.

What you’ll do

  • Build and own the accelerator runtime in C++, covering memory management, DMA, streams and async scheduling

  • Enable multi-chip execution and integrate with PyTorch, JAX and serving stacks such as vLLM

Requirements

Artificial Intelligence (AI), ASIC (Application Specific Integrated Circuit), Startup, Artificial Intelligence (AI), GPU (Graphics Processing Unit), Memory Hardware, Schedule Development, Kernel Programming, C++ Programming Language, Memory Management

About the company

Our client is a well-funded California start-up building custom ASICs for AI inference and training, delivering better performance per watt than general-purpose GPUs., * Optimize end-to-end latency and throughput, and build profiling and debug toolsDarwin Recruitment is acting as an Employment Agency in relation to this vacancy.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerbuilder.com
Prepare application

Good distractions

Loading talks and stories from around this role…