> Markdown version of [/jobs/ext/4244035-software-engineer-inference](https://www.wearedevelopers.com/jobs/ext/4244035-software-engineer-inference). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Software Engineer, Inference

- **Company:** Coreweave Inc
- **Location:** Bellevue, WA, United States
- **Experience:** Starter
- **Salary:** $120,000.0 - $160,000.0
- **Contract:** Permanent contract
- **Skills:** Application Programming Interfaces (APIs), Python (Programming Language), Prometheus, Software Engineering, Data Streaming, TorchServe, Data Logging, Large Language Models, Grafana, Caching, Containerization, Kubernetes, Ray Serve, Slurm, Machine Learning Operations, TensorRT, Mixed Precision, VLLM
- **Published:** October 25, 2026
- **Apply:** https://www.indeed.com/viewjob?jk=71a7105d5e449b3c

## About the Role

* 0-3 years of software engineering experience (or equivalent) building cloud/distributed services in production.
 * Proficiency in Python or Go; familiarity with gRPC/HTTP APIs and containerized deployments.
 * Working knowledge of Kubernetes (or Slurm/Ray) and CI/CD pipelines.
 * Experience with metrics/alerting (Prometheus/Grafana/OpenTelemetry) and structured logging.
 * Basic understanding of GPU inference concepts (KV caching, mixed precision, streaming tokens).

Nice to have

 * Experience with inference frameworks (Triton, vLLM, TensorRT-LLM, Ray Serve, TorchServe).
 * Hands-on performance profiling/benchmarking (e.g., wrk, vegeta, perf, Nsight).
 * Contributions to reliability practices: SLI/SLOs or postmortem improvements.

## Description

As a Junior Software Engineer (IC1/IC2) on the Inference team, you'll own a single production service end-to-end shipping features, maintaining dashboards/alarms, and improving operational excellence. You'll collaborate with peers across runtime, scheduling, and networking to move key SLIs.

What you'll do

 * Own one model-serving service end-to-end: design, implementation, tests, deployment, and ops.
 * Add and tune observability (dashboards, alerts, traces); automate runbook steps to reduce toil.
 * Improve latency/throughput via micro-batching, concurrency tuning, and caching.
 * Participate in on-call; lead post-incident action items for your service.
 * Review peers' PRs and contribute design feedback in team reviews.