> Markdown version of [/jobs/ext/3104433-software-engineer-inference-ai-ml](https://www.wearedevelopers.com/jobs/ext/3104433-software-engineer-inference-ai-ml). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Software Engineer, Inference AI/ML

- **Company:** Coreweave Inc
- **Location:** Bellevue, WA, United States
- **Salary:** $92,000.0 - $135,000.0
- **Contract:** Internship / Graduate position
- **Skills:** Artificial Intelligence, C++ (Programming Language), Code Review, Nvidia CUDA, Data Structures, Linux, Python (Programming Language), Tensorflow, Prometheus, Pytorch, Large Language Models, Grafana, Code Comments, Git, Kubernetes, TensorRT
- **Published:** September 27, 2026
- **Apply:** https://www.juju.com/job/16_8273a763

## About the Role

* BS/MS in CS, EE, or related field, or equivalent practical experience.
 * Foundations in data structures, algorithms, and networked services.
Experience with Python or Go (C++ a plus) and Linux fundamentals; Git/CI basics.
Exposure to containers and Kubernetes (coursework or projects welcome).
Curiosity about GPU inference concepts (micro-batching, KV cache, streaming).

Preferred:

 * Internship or project that deployed a microservice or ML inference demo.
 * Coursework/research with PyTorch or TensorFlow; simple CUDA projects a plus.
 * Familiarity with Grafana/Prometheus/OpenTelemetry or similar tooling.

## Description

Join the Inference team to ship production features that improve latency, reliability, and cost for model serving on our GPU platform. As an IC1, you'll implement well-scoped changes, learn our operational practices, and grow quickly with mentorship from experienced engineers.
About the role:

 * Implement well-scoped features and fixes in Python/Go/C++ for model-serving services (e.g., Triton, vLLM, TensorRT-LLM, Ray Serve).
 * Write tests, code comments, and short design docs; participate in code reviews.
 * Add basic metrics and dashboards; assist with alarms and runbooks.
 * Follow on-call runbooks and learn incident response in a guided rotation.
 * Contribute to performance experiments (e.g., request batching, concurrency, caching) with guidance.


## Related Videos

- [WWC24 - Ankit Patel - Unlocking the Future Breakthrough Application Performance and Capabilities with NVIDIA](https://www.wearedevelopers.com/videos/920-wwc24-ankit-patel-unlocking-the-future-breakthrough-application-performance-and-capabilities-with-nvidia)
- [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94)
- [Photonic Computing: Programming a New Class of AI Accelerators (incl. Live Coding)](https://www.wearedevelopers.com/videos/100196-photonic-computing-programming-a-new-class-of-ai-accelerators-incl-live-coding)
- [Docker network without Docker](https://www.wearedevelopers.com/videos/1418-docker-network-without-docker)
- [Shipping Faster with Less: Render on Cloud Hosting, AI Workloads, and the Future of DevOps](https://www.wearedevelopers.com/videos/1894-shipping-faster-with-less-render-on-cloud-hosting-ai-workloads-and-the-future-of-devops)
- [Git for Code Reviews](https://www.wearedevelopers.com/videos/429-git-for-code-reviews)

## Related Articles

- [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers)
- [Best US AI Conferences for CTOs in 2026: Build vs. Buy, Vendor Evaluation, and Peer Intelligence](https://www.wearedevelopers.com/magazine/736-best-us-ai-conferences-for-ctos-in-2026-build-vs-buy-vendor-evaluation-and-peer-intelligence)
- [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development)
- [Dev Digest 121 - AI goes offline](https://www.wearedevelopers.com/magazine/456-dev-digest-121-ai-goes-offline)
- [Dev Digest 132 - Binging WADFlix?](https://www.wearedevelopers.com/magazine/473-dev-digest-132-binging-wadflix)
- [Dev Digest 137 - AI'm not sure about this](https://www.wearedevelopers.com/magazine/485-dev-digest-137-ai-m-not-sure-about-this)