Cloud Inference Engineer

Founding, on site in downtown SF. Ship low latency, high throughput model serving on Luminal Cloud.

Day to day responsibilities:

• Deploy and tune models with optimizations like KV caching, paged attention, sequence packing, etc.
• Conducting model performance reviews
• Improve scheduler, batcher, autoscaling; profile latency, cost, utilization
• Sometimes write kernels and, yes, occasional tasteful shitposting

• CUDA + GPU inference optimization
• vLLM, SGLang, or TensorRT-LLM experience
• KV caching, paged attention, batching, token streaming, etc.
• Distributed compute (with GPUs is a super plus)
• No degree required

Luminal (YC S25) builds an AI compiler and serving stack that makes models 10x faster and production ready with one line.