Technical Lead - GPU Infrastructure

Tether Operations Limited
Madrid, Spain
4 days ago
Apply on www.adzuna.es
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience required
3 years minimum
Working hours
Regular working hours
Languages
English
Job source

Tech stack

JavaScript (Programming Language) Application Programming Interfaces (APIs) Artificial Intelligence Application Layers Big Data Command-Line Interface Nvidia CUDA Linux DevOps File Systems Distributed Systems Infrastructure as a Service (IaaS)
+24 more
InfiniBand Subnetting Network Control Node.Js Peer-To-Peer (P2P) Platform as a Service (PAAS) PCI Express Performance Tuning Remote Direct Memory Access Prometheus Data Logging High Performance Computing Autoscaling Large Language Models Grafana Backend Kubernetes Information Technology Bare Metal Slurm Front End Software Development TensorRT Hardware Infrastructure Nvme

Job description

This position is listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Technical Lead - GPU Infrastructure based in Spain. This is a hands-on technical leadership role responsible for architecting and delivering a large-scale GPU infrastructure platform. You will lead the evolution from managed Kubernetes workloads toward bare-metal GPU infrastructure, including Slurm-based research computing and Kubernetes-powered inference. The role combines deep systems expertise with engineering leadership, team management, and direct ownership of architecture and delivery. You will oversee a distributed team spanning backend, frontend, DevOps, QA, and documentation while maintaining high technical standards. Your work will support research, model training, and managed inference workloads requiring reliable, scalable, and observable GPU compute. You will also serve as the primary technical interface with infrastructure partners, hardware providers, and internal platform consumers. This is an opportunity to shape the architecture and operational foundations of a sophisticated GPU platform in a fully remote environment. Accountabilities: The Technical Lead will own the platform architecture and engineering delivery while remaining deeply involved in technical decisions, infrastructure operations, team leadership, and partner relationships.

  • Own the end-to-end platform architecture, including architecture proposals, high-level and low-level designs, technical reviews, and ongoing architecture documentation.
  • Lead and line-manage a distributed engineering team across backend, frontend, DevOps, QA, and documentation.
  • Establish engineering standards, oversee code and design reviews, manage release gates, conduct one-to-ones, and provide growth and performance feedback.
  • Design, build, and operate a managed Slurm service supporting research and model-training workloads.
  • Own Slurm controllers, accounting, partitions, login nodes, node onboarding, acceptance testing, driver and CUDA baselines, upgrades, stalled-job detection, node health, draining, autohealing, storage visibility, identity, and workload isolation.
  • Lead GPU infrastructure operations on bare-metal environments, including NVIDIA drivers, CUDA, Fabric Manager, NVSwitch, DCGM, MIG, node burn-in, and acceptance processes.
  • Own Kubernetes cluster bootstrap and lifecycle on partner-provided bare metal, including NVIDIA GPU Operator and Network Operator.
  • Oversee GPU isolation using technologies such as KubeVirt and VFIO and manage day-two infrastructure operations, upgrades, backup, recovery, and node replacement.
  • Define managed inference architecture covering serving, multi-GPU and multi-node parallelism, autoscaling, request routing, endpoint reliability, and confidential-compute capabilities.
  • Establish observability across the control plane, GPU fleet, and application layers through metrics, logging, alerting, and SLOs.
  • Lead incident response, post-incident reviews, and the development of an on-call model that is sustainable for a lean engineering organization.
  • Act as the primary technical interface with infrastructure partners and vendors, translating requirements into written specifications and acceptance tests.
  • Manage technical escalations with partners through resolution and contribute to capacity planning and hardware sourcing decisions.
  • Work directly with research, model-training, and product teams to translate workloads into platform requirements and manage capacity constraints.
  • Hire and develop members of the platform team while maintaining a high technical bar.
  • Contribute to architecture decisions involving distributed systems, high-performance computing, networking, storage, virtualization, and GPU workloads.

Requirements

The ideal candidate combines deep hands-on GPU and infrastructure expertise with proven technical leadership experience. They should be comfortable operating complex production systems, making architecture decisions, leading distributed teams, and remaining close to the code and infrastructure.

  • 8+ years of hands-on engineering experience, including at least 3 years leading teams responsible for infrastructure platforms used by other teams.
  • Bachelor’s or Master’s degree in computer science, engineering, or a related field, or equivalent practical experience.
  • Extensive hands-on experience operating Slurm in production, including slurmctld, slurmdbd, partitions, QoS, priority, accounting, prolog and epilog, node health, and upgrades.
  • Experience operating HPC or GPU training clusters for research or model-development users.
  • Strong experience operating NVIDIA GPU fleets on bare metal, including driver and CUDA lifecycles, Fabric Manager, NVSwitch, DCGM, MIG, node burn-in, and acceptance.
  • Deep knowledge of InfiniBand, subnet configuration, RDMA, SR-IOV, and diagnosing multi-node NCCL performance issues.
  • Strong Linux systems expertise, including kernel modules, drivers, PCIe passthrough, vfio-pci, cgroups, namespaces, and performance tuning.
  • Proven production Kubernetes experience covering control planes, upgrades, CNI, CSI, operators, custom controllers, and multi-tenancy.
  • Experience with HPC storage and large-scale data movement, including shared filesystems such as VAST, Lustre, or NFS and node-local NVMe caching.
  • Experience distributing large model weights and datasets across multiple nodes.
  • Strong observability and operations experience with Prometheus, Grafana, Loki, or comparable platforms, including SLOs, incident response, and post-incident reviews.
  • Working proficiency in JavaScript and Node.js sufficient to review control-plane, CLI, and worker services and make architecture decisions.
  • Experience delivering a multi-tenant IaaS, PaaS, research computing service, or comparable platform with resource isolation, quotas, usage metering, APIs, and CLI interfaces.
  • Demonstrated people leadership across time zones and the ability to lead cross-functional technical reviews.
  • Strong written architecture and decision-making skills, including documenting alternatives and trade-offs.
  • Confidence communicating technical decisions and respectfully challenging partners or executives when necessary.
  • Excellent written and spoken English.
  • Fully remote availability with a working location between UTC and UTC+5:30 to provide overlap with teams and partners across Europe and India.
  • Willingness to travel occasionally to partner sites and team events. Desirable experience includes:

  • Slurm operators on Kubernetes, such as Soperator or Slinky, or Kubernetes-native schedulers such as Kueue, Volcano, KAI, or Kubeflow Trainer.
  • Modern model-serving technologies such as vLLM, SGLang, or TensorRT-LLM.
  • GPU parallelism strategies, quantization trade-offs, and GPU memory planning.
  • Multi-tenant GPU isolation using KubeVirt, Kata Containers, QEMU/KVM, Firecracker, or similar technologies.
  • Confidential computing technologies such as Intel TDX, AMD SEV-SNP, or NVIDIA confidential-compute capabilities.
  • Cluster API, kubeadm, Cilium, GPU autohealing, infrastructure as code, and GitOps.
  • Experience working on the operator side of a GPU cloud, university or national HPC center, or AI research platform.
  • Peer-to-peer or distributed-systems experience.
  • Experience working with hardware providers responsible for provisioning but not operating infrastructure, including establishing contracts and acceptance tests.

Benefits & conditions

  • 100% remote position.
  • Opportunity to lead the architecture and delivery of a sophisticated GPU infrastructure platform.
  • High-impact technical leadership role spanning bare-metal GPU infrastructure, Slurm, Kubernetes, inference, and observability.
  • Leadership responsibility for a distributed engineering organization across multiple technical disciplines.
  • Significant ownership over architecture, engineering standards, delivery planning, and team development.
  • Direct involvement with infrastructure partners and hardware providers.
  • Opportunity to support advanced AI research, model training, and managed inference workloads.
  • International and distributed working environment with colleagues and partners across Europe and India.
  • Occasional opportunities for travel to partner locations and team events.
  • Opportunity to work at the intersection of high-performance computing, AI infrastructure, distributed systems, and cloud-native technologies.

About the company

Tether Operations Limited España Technical Lead - GPU Infrastructure (100% Remote - Worldwide) Tether Operations Limited España Senior AI Infra Product Lead - Sovereign GPUaaS 90.000 - 130.000 Vodafone Group Plc Madrid, Comunidad de Madrid Technical Lead Bjak Spain Senior AI Infrastructure Product Manager - Sovereign GPUaaS 85.000 - 120.000 Vodafone Madrid, Comunidad de Madrid Volver a la última búsqueda Trabajos ) Trabajos en informática ) Technical Lead - GPU Infrastructure ( volver a la última búsqueda Recibir ofertas similares por correo electrónico No gracias, llévame a la oferta de empleo Al crear una alerta, aceptas nuestros Términos y condiciones y Política de privacidad, y el uso de cookies. Inscribirse en esta oferta

Profesiones

  • Técnico
  • Recepciónista
  • Administrador
  • Ventas
  • Enfermero

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.adzuna.es
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:22 min

Infrastructure barriers and compliance risks in research

Jeremy Murray Jeremy Murray · World Congress 2026 Europe

52 sec

Running persistent Linux environments directly on Windows

Ben Breard Ben Breard · World Congress 2025

1:15 min

Transitioning to hybrid clouds amid GPU scarcity

Jeremy Murray Jeremy Murray · World Congress 2026 Europe

1:51 min

Managing GPU quotas and multi-tenancy with Kueue

Jeremy Murray Jeremy Murray · World Congress 2026 Europe

1:37 min

Unlocking direct GPU access within managed Kubernetes platforms

Kevin Klues Kevin Klues

3:55 min

Demonstrating .NET installation on Debian and Azure Linux

Silvano Coriani Silvano Coriani · Europe 2026 Virtual

Videos

See all

Related articles

See all