> Markdown version of [/jobs/ext/2724859-software-developer-models-team-token-factory](https://www.wearedevelopers.com/jobs/ext/2724859-software-developer-models-team-token-factory). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Software Developer: Models Team (Token Factory)

- **Company:** Nebius B V
- **Location:** Netherlands (Remote available)
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Artificial Intelligence, Cloud Computing, Computer Programming, Distributed Systems, Fault Tolerance, InfiniBand, Python (Programming Language), High Performance Computing, Autoscaling, Large Language Models, Backend, Kubernetes, Decoding
- **Published:** September 5, 2026
- **Apply:** https://startup.jobs/senior-software-developer-models-team-token-factory-nebius-8551188

## About the Role

* Experience serving LLMs in production
 * Strong Python and/or Go programming skills
 * Experience designing and operating highly scalable, highly available distributed services

Nice to have:

 * Contributions to vLLM, SGLang, TRT-LLM, or NVIDIA ecosystem open-source projects
 * Deep understanding of KV cache management, speculative decoding, and quantization
 * Experience with LLM evaluation frameworks
 * Hands-on experience with performance benchmarking and optimization
 * Deep understanding of Kubernetes
 * Familiarity with distributed serving architectures and autoscaling
 * Knowledge of InfiniBand, RoCE, or high-performance networking, Applicants must be authorized to work in the country in which they apply and will be required to provide proof of employment eligibility as a condition of hire.

## Description

Our work is deeply integrated with the broader cloud and infrastructure ecosystem. We primarily use Go and Python to build and scale backend systems. We collaborate closely with teams working on cloud infrastructure, observability, reliability, fault tolerance, and platform engineering. The challenges we solve sit at the intersection of distributed systems, high-performance computing, and modern AI infrastructure.


## Related Videos

- [Tour de Force: Open-Source LLM Inference Optimization from Simple to Sophisticated](https://www.wearedevelopers.com/videos/100099-tour-de-force-open-source-llm-inference-optimization-from-simple-to-sophisticated)
- [The Gashlycrumb Tinies of AI Networking You Must Know (or Languish!)](https://www.wearedevelopers.com/videos/2067-the-gashlycrumb-tinies-of-ai-networking-you-must-know-or-languish)
- [Developing the Backend with Stefan Lingler, CTO at Shpock](https://www.wearedevelopers.com/videos/100360-developing-the-backend-with-stefan-lingler-cto-at-shpock)
- [Efficient deployment and inference of GPU-accelerated LLMs​](https://www.wearedevelopers.com/videos/929-efficient-deployment-and-inference-of-gpu-accelerated-llms)
- [Challenges and Solutions for Efficient, Large-Scale Video Analysis](https://www.wearedevelopers.com/videos/2022-challenges-and-solutions-for-efficient-large-scale-video-analysis)
- [Nest.js - TypeScript in the backend can also be clean](https://www.wearedevelopers.com/videos/1033-nest-js-typescript-in-the-backend-can-also-be-clean)

## Related Articles

- [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models)
- [Dev Digest 121 - AI goes offline](https://www.wearedevelopers.com/magazine/456-dev-digest-121-ai-goes-offline)
- [The Best Large Language Models on The Market](https://www.wearedevelopers.com/magazine/319-the-best-large-language-models-on-the-market)
- [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again)
- [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)