> Markdown version of [/jobs/ext/4624694-senior-ml-infrastructure-engineer](https://www.wearedevelopers.com/jobs/ext/4624694-senior-ml-infrastructure-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Senior ML Infrastructure Engineer

- **Company:** SambaNova Systems, Inc.
- **Location:** San Jose, CA, United States
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Application Programming Interfaces (APIs), Data Structures, Distributed Systems, Python (Programming Language), Large Language Models, Concurrency, Caching, Information Technology, SGLang, Machine Learning Operations, TensorRT, Api Design, VLLM, Model Inference, Decoding
- **Published:** November 7, 2026
- **Apply:** https://www.juju.com/job/28_25303_1e44622443d4bbb6285919b9b0554923

## About the Role

Design and operate production-grade inference infrastructure on RDU architecture to optimize performance and cost. Own the public API surface and build accuracy verification infrastructure to ensure reliable, high-throughput services.

Requirements: Requires a B.S. in Computer Science or a related field and 5+ years of experience building large-scale distributed systems. Must be proficient in Python and familiar with modern LLM inference techniques and serving stacks like vLLM.

Key Skills: Distributed Systems, ML Serving, Python, Systems Design, LLM Inference, vLLM, Algorithms, Data Structures, Concurrency, API Design, Speculative Decoding, Constrained Decoding, Prompt Caching, Long-context Inference, TensorRT-LLM, SGLang