Senior Runtime Engineer - AI Accelerator
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
Job description
You will own the software layer between ML frameworks and the accelerator hardware: the runtime that loads models, manages memory and schedules work across chips.
Working with compiler, kernel and hardware teams, you will decide how much of the silicon’s performance reaches real workloads.
What you’ll do
-
Build and own the accelerator runtime in C++, covering memory management, DMA, streams and async scheduling
-
Enable multi-chip execution and integrate with PyTorch, JAX and serving stacks such as vLLM
Requirements
Artificial Intelligence (AI), ASIC (Application Specific Integrated Circuit), Startup, Artificial Intelligence (AI), GPU (Graphics Processing Unit), Memory Hardware, Schedule Development, Kernel Programming, C++ Programming Language, Memory Management
About the company
Our client is a well-funded California start-up building custom ASICs for AI inference and training, delivering better performance per watt than general-purpose GPUs., * Optimize end-to-end latency and throughput, and build profiling and debug toolsDarwin Recruitment is acting as an Employment Agency in relation to this vacancy.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this role…