> Markdown version of [/jobs/ext/4636338-cloud-inference-engineer](https://www.wearedevelopers.com/jobs/ext/4636338-cloud-inference-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Cloud Inference Engineer

- **Company:** LUMINAL LLC
- **Location:** San Francisco, CA, United States
- **Salary:** $150,000 - $250,000
- **Contract:** Permanent contract
- **Skills:** Cloud Computing, Nvidia CUDA, Graphics Processing Unit (GPU), Large Language Models, Low Latency, SGLang, TensorRT
- **Published:** November 8, 2026
- **Apply:** https://www.indeed.com/viewjob?jk=b0b1e4da10e33c66

## About the Role

* CUDA + GPU inference optimization
 * vLLM, SGLang, or TensorRT-LLM experience
 * KV caching, paged attention, batching, token streaming, etc.
 * Distributed compute (with GPUs is a super plus)
 * No degree required

## Description

Founding, on site in downtown SF. Ship low latency, high throughput model serving on Luminal Cloud.

Day to day responsibilities:

 * Deploy and tune models with optimizations like KV caching, paged attention, sequence packing, etc.
 * Conducting model performance reviews
 * Improve scheduler, batcher, autoscaling; profile latency, cost, utilization
 * Sometimes write kernels and, yes, occasional tasteful shitposting