Machine Learning Systems Engineer

Digital Waffle
Menlo Park, CA, United States
4 days ago
Apply on www.juju.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience required
1 year minimum
Compensation
$350,000
Working hours
Regular working hours
Job source

Tech stack

Nvidia CUDA Distributed Systems Remote Direct Memory Access Pytorch Deep Learning Machine Learning Operations

Requirements

  • 1+ years in deep learning training or inference systems, or distributed systems
  • Hands-on experience with CUDA, Triton, PyTorch, NCCL or RDMA
  • Someone who gets genuinely excited about shaving milliseconds off production workloads

About the company

Member of Technical Staff, ML Systems San Fransisco (On-site) $350K-$550K + Equity

Would you rather make a video model 10x faster than train one?

We’re partnering with a seed-funded AI infrastructure startup that’s rebuilding the training and inference stack for world models, from the GPU kernels all the way up to distributed serving. Today’s ML stack was built for language models. This team is rebuilding it for image, video and world-model workloads, and their public benchmarks already show order-of-magnitude speedups at a fraction of the cost.

The team is five cofounders with deep expertise across distributed systems, kernel optimization, cloud infrastructure and research. You’d be one of the first engineering hires, reporting directly to the CEO.

What you’ll do:

  • Optimize GPU and system performance for image, video and world-model training and inference
  • Profile and remove bottlenecks at the kernel, memory, system and cluster level using Nsight and related tooling
  • Write low-level CUDA and Triton optimizations on code paths that run in production
  • Build distributed inference and training engines for diffusion models across multiple GPUs and nodes
  • Own communication performance: NCCL, RDMA over InfiniBand/RoCE, and disaggregated serving
  • Build benchmarking and regression harnesses so performance gains stick

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.juju.com
Prepare application

Good distractions

Loading talks and stories from around this role…