> Markdown version of [/jobs/ext/4627229-senior-software-engineer-inference-backend](https://www.wearedevelopers.com/jobs/ext/4627229-senior-software-engineer-inference-backend). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Senior Software Engineer - Inference Backend

- **Company:** Lambda Inc.
- **Location:** San Francisco, CA, United States (Remote available)
- **Experience:** Expert
- **Salary:** $325,000
- **Contract:** Permanent contract
- **Skills:** Application Programming Interfaces (APIs), Distributed Systems, Internet Traffics, Python (Programming Language), Machine Learning, Graphics Processing Unit (GPU), Backend, Kubernetes, Machine Learning Operations
- **Published:** November 7, 2026
- **Apply:** https://www.juju.com/job/28_25304_ab57c933aad54017af24867d47cafe39

## About the Role

* 5 or more years of experience as a software engineer working on large-scale production services
 * 1 year or more of experience working with machine learning (inference experience preferred, but other areas are acceptable)
 * Highly skilled at writing Go or Python
 * Product-focused engineer, always considering the user and operational costs as you are exploring new
 * Proven track record of working in an environment with rapid deployment and the ability to stay on top of shifting priorities as the industry rapidly develops
 * Willingness to take ownership of projects and help drive them forwards through design, implementation, launch, and maintenance.
 * Some experience running and operating production services handling real-time web/internet traffic, * Have built ML inference systems at scale
 * Experience developing large-scale, geographically distributed systems
 * Intermediate or better skill at writing Rust
 * Experience developing Kubernetes operators and components
 * Network engineering experience

## Description

Note: This position requires presence in our San Francisco office location 4 days per week; Lambda's designated work from home day is currently Tuesday., * Work on our Inference service, helping us to develop our large-scale platform for running new, cutting-edge models across tens of thousands of GPUs

 * Help build a high-throughput, low-latency API and routing system running at geographically-distributed scale
 * Work with the team and our internal ML researchers to adopt and improve new inference engines, models and architectures across a variety of different mediums (such as text, image, video and audio)
 * Shape a highly reliable distributed system with a focus on reducing operational overhead and deep observability and capacity management.
 * Help push Lambda forward into the state of the art, and be part of a team that is operating right at the edge of new developments in the industry.