> Markdown version of [/jobs/ext/4293796-software-engineer-inference](https://www.wearedevelopers.com/jobs/ext/4293796-software-engineer-inference). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Software Engineer, Inference

- **Company:** Coreweave Inc
- **Location:** Sunnyvale, CA, United States
- **Experience:** Starter
- **Salary:** $120,000.0 - $160,000.0
- **Contract:** Permanent contract
- **Skills:** Application Programming Interfaces (APIs), Python (Programming Language), Prometheus, Software Engineering, TorchServe, Data Logging, Large Language Models, Grafana, Containerization, Kubernetes, Ray Serve, Slurm, TensorRT, Mixed Precision, VLLM
- **Published:** October 27, 2026
- **Apply:** https://www.thejobnetwork.com/job/0994a80e-006f-4c63-ba5f-d1e7464b2ff8/software-engineer-inference

## About the Role

- 0-3 years of software engineering experience (or equivalent) building cloud/distributed services in production.
- Proficiency in Python or Go; familiarity with gRPC/HTTP APIs and containerized deployments.
- Working knowledge of Kubernetes (or Slurm/Ray) and CI/CD pipelines.
- Experience with metrics/alerting (Prometheus/Grafana/OpenTelemetry) and structured logging.
- Basic understanding of GPU inference concepts (KV caching, mixed precision, streaming tokens).

**Nice to have**

- Experience with inference frameworks (Triton, vLLM, TensorRT-LLM, Ray Serve, TorchServe).
- Hands-on performance profiling/benchmarking (e.g., wrk, vegeta, perf, Nsight).
- Contributions to reliability practices: SLI/SLOs or postmortem improvements.