> Markdown version of [/jobs/ext/4754111-software-engineer-ai-inference](https://www.wearedevelopers.com/jobs/ext/4754111-software-engineer-ai-inference). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Software Engineer AI Inference - **Company:** Scaleway - **Location:** Paris, France - **Contract:** Permanent contract - **Skills:** Application Programming Interfaces (APIs), Artificial Intelligence, Cloud Computing, Code Review, Nvidia CUDA, DevOps, Distributed Systems, Machine Learning, Open Source Technology, Performance Tuning, Large Language Models, Generative AI, Backend, Kubernetes, HuggingFace, Hardware Infrastructure, Stable Diffusion, Model Inference, KServe, Golang - **Published:** November 17, 2026 - **Apply:** https://www.welcometothejungle.com/en/companies/scaleway/jobs/software-engineer-ai-inference_paris ## About the Role * Strong experience with Golang in production environments * Proficiency with Kubernetes and container orchestration tools * Knowledge about AI models (LLMs, Diffusion models, …) * Hands-on experience with deploying and scaling ML models is appreciated * Solid understanding of backend architectures and DevOps practices SOFTSKILLS * Fast learner with high adaptability to new technologies * Strong curiosity and willingness to dive deep into emerging AI tools * Proactive mindset and readiness to take initiative * Technical autonomy and ownership of your scope * Clear communicator, capable of explaining complex systems simply ## Description As Scaleway expands its AI capabilities, we are strengthening our AI Inference team to build and scale our next-generation inference platform. Your mission will be to design, build, and operate high-performance AI inference infrastructure, enabling the deployment of LLMs and generative AI workloads at scale. You will tackle challenges in distributed systems, GPU infrastructure, and performance optimization, helping shape the future of sovereign AI cloud infrastructure in Europe. YOUR FUTURE TEAM We work in a collaborative and international environment where the diversity of Scalers, combined with a spirit of sharing, helps bring new projects to life every day, advancing our ambitions together. You will be part of a team of 4 DevOps engineers, working closely on backend and infrastructure topics related to AI inference. The squad is part of a broader AI tribe focused on four strategic products: * Managed Inference, a platform to deploy, scale, and monitor AI models in production * Generative APIs, a unified API layer to access cutting-edge generative models (LLMs, Diffusion, etc.) * AI HPC, serving massive clusters, with thousands of GPU, to high end customers with strong model training needs * AI Tooling, developing in house technologies to boost Scaleway and the Iliad Group in their daily tasks ️ YOUR DAILY ROUTINE INCLUDES: * Build and operate infrastructure for serving LLMs and other generative models at scale * Design, deploy, and maintain Kubernetes-based services optimized for AI inference * Develop in Golang to build robust and efficient backend services * Optimize serving stacks using tools like vLLM, Triton, and CUDA * Integrate open-source AI tooling such as Hugging Face, KServe, or custom components * Participate in architecture discussions and make high-impact technical decisions * Keep up with the fast-paced evolution of AI serving ecosystems * Troubleshoot and resolve complex infrastructure and deployment issues * Collaborate with internal teams to integrate new AI features * Contribute to code reviews and knowledge sharing within the team