> Markdown version of [/jobs/ext/2895267-ai-infrastructure-engineer-gpu-remote-emea](https://www.wearedevelopers.com/jobs/ext/2895267-ai-infrastructure-engineer-gpu-remote-emea). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Ai Infrastructure Engineer (Gpu) - Remote Emea

- **Company:** Pragmatike
- **Location:** Madrid, Spain (Remote available)
- **Contract:** Permanent contract
- **Skills:** Artificial Intelligence, Cloud Computing, Nvidia CUDA, Data Transmissions, Software Debugging, Distributed Systems, General-Purpose Computing on Graphics Processing Units, Python (Programming Language), Machine Learning, Performance Tuning, Reliability Engineering, Azure Machine Learning, AI Infrastructure, System Availability, Delivery Pipeline, Kubernetes, Infrastructure Automation Frameworks, Low Latency, Deployment Automation, Machine Learning Operations, Terraform
- **Published:** September 14, 2026
- **Apply:** https://www.buscojobs.com.es/ai-infrastructure-engineer-gpu-remote-emea-en-madrid-ID-371237804

## About the Role

4+ years of experience in ML Ops, Platform Engineering, SRE, or similar infrastructure roles focused on ML systems
Hands-on experience with model serving frameworks such as vLLM, TGI, Triton, or equivalent
Strong background in container orchestration and operating GPU-based workloads in production
Experience with MLOps tooling including model registries, experiment tracking, and automated deployment pipelines
Proficiency in Python and infrastructure-as-code tools (e.g., Terraform, Helm, or similar)
Strong understanding of distributed systems, performance tuning, and production reliability engineering
Ability to effectively use AI coding assistants to accelerate development and debugging workflows
Ownership mindset with the ability to operate independently in a remote-first environment
Preferred Qualifications
Experience with ML platforms such as Kubeflow, MLflow, or KubeAI
Knowledge of GPU scheduling, CUDA/ROCm optimization, or multi-tenant inference systems
Experience with cost optimization across different GPU types and inference workloads
Background in early-stage startups or greenfield infrastructure projects
Proven experience building production systems from scratch rather than maintaining legacy platforms

## Description

OverviewLocation:Fully remote (EMEA timezone)Start date:ASAPLanguages:Fluent English requiredIndustry:Cloud Computing / AI / European Deep-Tech SaaSAbout The RolePragmatike is recruiting on behalf of a fast-scaling, well-funded distributed cloud infrastructure startup building next-generation AI-native cloud services.The company is redefining how compute is delivered by providing GPU-powered infrastructure for AI/ML workloads, secure storage, and high-speed data transfer through a decentralized architecture that significantly reduces environmental impact compared to traditional cloud providers.We are seeking aAI Infrastructure Engineerwith strong experience in production-grade model serving and infrastructure for AI systems.This is a highly technical, hands-on role focused on building scalable, reliable, and efficient ML inference platforms powering real-time AI applications.You will be responsible for designing and operating the core infrastructure that serves machine learning models at scale.You will work closely with infrastructure, platform, and applied AI teams to ensure high availability, low latency, and cost-efficient inference systems.Strong ownership, production mindset, and experience with distributed GPU systems are essential.Your ResponsibilitiesBuild and operate production-grade model serving infrastructure using frameworks such as vLLM, TGI, Triton, or equivalentDesign and implement robust deployment pipelines with blue/green and canary rollout strategies for ML modelsDevelop and maintain auto-scaling systems, multi-model serving architectures, and intelligent request routing layersOptimize GPU utilization, memory efficiency, network throughput, and model artifact storage performanceDesign observability systems for tracking inference latency, throughput, GPU usage, cost metrics, and system healthManage model registries and CI/CD pipelines enabling automated and reproducible model deploymentsOwn the full lifecycle of ML systems from development through production, including operational support and on-call responsibilitiesDefine engineering best practices and contribute to platform scalability in a fast-moving startup environmentRequired Qualifications4+ years of experience in ML Ops, Platform Engineering, SRE, or similar infrastructure roles focused on ML systemsHands-on experience with model serving frameworks such as vLLM, TGI, Triton, or equivalentStrong background in container orchestration and operating GPU-based workloads in productionExperience with MLOps tooling including model registries, experiment tracking, and automated deployment pipelinesProficiency in Python and infrastructure-as-code tools (e.g., Terraform, Helm, or similar)Strong understanding of distributed systems, performance tuning, and production reliability engineeringAbility to effectively use AI coding assistants to accelerate development and debugging workflowsOwnership mindset with the ability to operate independently in a remote-first environmentPreferred QualificationsExperience with ML platforms such as Kubeflow, MLflow, or KubeAIKnowledge of GPU scheduling, CUDA/ROCm optimization, or multi-tenant inference systemsExperience with cost optimization across different GPU types and inference workloadsBackground in early-stage startups or greenfield infrastructure projectsProven experience building production systems from scratch rather than maintaining legacy platformsWhy Join UsTake ownership of critical infrastructure powering a rapidly scaling AI-native cloud platformBuild foundational ML inference systems from the ground up in a high-growth, well-funded startupWork at the intersection of distributed systems, GPU computing, and sustainable cloud architectureGain deep expertise in next-generation AI infrastructure and large-scale model serving systemsInfluence core engineering decisions and define best practices that will scale with the company.Pragmatike is committed to a fair, transparent, and inclusive recruitment process.We do not discriminate based on age, disability, gender, gender identity or expression, marital or civil partner status, pregnancy or maternity, race, religion or belief, sex, or sexual orientation.In accordance with GDPR, your personal data will be processed lawfully, fairly, and securely, and used solely for recruitment purposes, including sharing it with our client(s) for employment consideration.#J-*****-Ljbffr


## Related Videos

- [Shipping Faster with Less: Render on Cloud Hosting, AI Workloads, and the Future of DevOps](https://www.wearedevelopers.com/videos/1894-shipping-faster-with-less-render-on-cloud-hosting-ai-workloads-and-the-future-of-devops)
- [Coffee with Developers - Stephen Jones - NVIDIA](https://www.wearedevelopers.com/videos/1303-coffee-with-developers-stephen-jones-nvidia)
- [Understanding Kubernetes in a visual way](https://www.wearedevelopers.com/videos/100085-understanding-kubernetes-in-a-visual-way)
- [Infrastructure as Code: The Developer's Secret Weapon](https://www.wearedevelopers.com/videos/1221-infrastructure-as-code-the-developer-s-secret-weapon)
- [A Deep Dive on How To Leverage the NVIDIA GB200 for Ultra-Fast Training and Inference on Kubernetes](https://www.wearedevelopers.com/videos/1625-a-deep-dive-on-how-to-leverage-the-nvidia-gb200-for-ultra-fast-training-and-inference-on-kubernetes)
- [Introduction to Azure Machine Learning](https://www.wearedevelopers.com/videos/368-introduction-to-azure-machine-learning)

## Related Articles

- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)
- [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud)
- [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift)
- [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development)
- [7 Cloud Computing Trends Coming in 2025 for Developers](https://www.wearedevelopers.com/magazine/412-7-cloud-computing-trends-coming-in-2025-for-developers)
- [MLOps – What’s the deal behind it?](https://www.wearedevelopers.com/magazine/125-mlops-what-s-the-deal-behind-it)