WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
World Congress 2026 Europe • Jul 10, 2026 • Session details

Instant KAI Sandboxes with vCluster: Multi-Tenant, Multi-Scheduler GPU Sharing

Piotr Zaniewski

Stop choosing between GPU utilization and Kubernetes stability. Discover how combining vCluster and NVIDIA KAI creates instant, multi-tenant AI sandboxes. Run different schedulers safely and maximize hardware density.

Pause
Mute Enter Fullscreen
#1 about 4 min

Challenges of shared Kubernetes clusters for AI workloads

Shared global components complicate software upgrades and limit scheduling flexibility for AI workloads.

#2 about 2 min

How the Kubernetes AI scheduler enables fractional GPU sharing

The dynamic resource allocator divides graphics hardware between specific workloads to improve utilization.

#3 about 2 min

Isolating control planes with virtual Kubernetes clusters

Running the application programming interface server inside a pod reduces the operational blast radius.

#4 about 3 min

Navigating the spectrum of Kubernetes multi-tenancy models

Virtual clusters balance full infrastructure isolation against sharing global services like ingress controllers.

#5 about 1 min

Exploring the internal architecture of vcluster components

The sinker component synchronizes specific resources between virtual environments and the underlying host platform.

#6 about 2 min

Verifying hardware access and exploring AI inference scaling

Large-scale machine learning processing requires robust cluster management software to efficiently allocate computational power.

#7 about 2 min

Demonstrating GPU workloads by generating text haikus

Generating haikus via a deployed language model verifies that the cluster correctly handles GPU-accelerated workloads.

#8 about 2 min

Configuring virtual clusters to run custom AI schedulers

Defining custom configurations encapsulates specialized scheduling logic within an isolated tenant environment.

#9 about 3 min

Deploying and connecting to the sandboxed control plane

Using terminal applications verifies the correct installation and functionality of the isolated control plane pods.

#10 about 2 min

Allocating fractional GPU resources using the isolated scheduler

Applying custom configuration files allows individual pods to consume exact percentages of shared graphics hardware.

#11 about 2 min

Provisioning multiple virtual clusters for concurrent tenant configurations

Deploying simultaneous isolated environments satisfies conflicting software version requirements across different engineering teams.

#12 about 2 min

Scaling virtual clusters to maximize hardware cost savings

Running thousands of encapsulated sandboxes on shared host nodes drastically reduces organizational computing costs.

#13 about 3 min

Verifying concurrent versions of isolated AI schedulers

Checking cluster stateful sets confirms that multiple scheduler versions operate independently without software interference.

#14 about 1 min

Documentation and community resources for cluster management tools

Directing developers to official documentation and community channels provides support for troubleshooting complex integrations.

#15 about 3 min

Configuring virtual clusters for multi-node GPU parallelization

Targeting dedicated infrastructure allows specialized workloads to distribute execution across multiple discrete computing devices.

Matching moments

1:54 min

Speaker background and open source Kubernetes edge computing projects

Gaurav Gahlot Gaurav Gahlot · WWC Europe 2026

4:49 min

Structuring compute and data services for AI models

Radu Vunvulea Radu Vunvulea · WWC 2025

2:04 min

Optimizing and deploying containerized AI inference workloads

Ankit Patel Ankit Patel · WWC 2024

1:37 min

Unlocking direct GPU access within managed Kubernetes platforms

Kevin Klues Kevin Klues

5:07 min

Actions Runner Controller architecture and cluster isolation

Bassem Dghaidi · LIVE

1:30 min

Overlooked AI infrastructure and operational deployment barriers

Stan Girard Stan Girard · WWC 2024

More from World Congress 2026 Europe

Building the Nervous System of AI - Michael Kagan (NVIDIA) thumbnail
29:17
about 1 month ago

Building the Nervous System of AI - Michael Kagan (NVIDIA)

Michael Kagan, Sead Ahmetović

Five Things in Tech that Matter Now - WeAreDevelopers World Congress 2026 Closing Keynote thumbnail
19:41
about 1 month ago

Five Things in Tech that Matter Now - WeAreDevelopers World Congress 2026 Closing Keynote

Christian Heilmann

The Sound of Your Secrets: Teaching Your Model to Spy, So You Can Learn to Defend thumbnail
32:06
about 1 month ago

The Sound of Your Secrets: Teaching Your Model to Spy, So You Can Learn to Defend

David vonThenen

Super scaling for the Super Bowl: How to survive 30 million users hitting your backend in 30 minutes thumbnail
35:13
about 1 month ago

Super scaling for the Super Bowl: How to survive 30 million users hitting your backend in 30 minutes

Irina Branovic

Running Secure Life Science Research at Scale using Hybrid GPU HPC and Kubernetes 🧬 thumbnail
24:23
about 1 month ago

Running Secure Life Science Research at Scale using Hybrid GPU HPC and Kubernetes 🧬

Jeremy Murray

Angstfreude - AI and Corporate Culture - The Thrill and the Threat thumbnail
30:26
about 1 month ago

Angstfreude - AI and Corporate Culture - The Thrill and the Threat

Axel Ebert, Karin Krobath

Upcoming sessions on this topic

Open session

World Congress 2026 North America

Trust, But Verify: Continuous GPU Validation at Scale

Kyle Bell

VP of AI @ TensorWave

Kyle Bell
Open session

World Congress 2026 North America

Autonomous Infrastructure: Building AI Agents for Global-Scale Capacity Efficiency

Gregoire Colin, Tommy Tran

Gregoire Colin
Tommy Tran
Open session

World Congress 2026 North America

Agents That Own Their Inference: Building Production AI Agents on Dedicated GPUs

Duan Lightfoot

Sr. AI Engineer, Akamai

Duan Lightfoot
Open session

World Congress 2026 North America

Run your agents in Kubernetes: Build once, deploy anywhere. But really?

Michal Salanci

Senior Systems Engineer at ESET Cybersecurity

Michal Salanci
Open session

World Congress 2026 North America

public void saveMoney(AI): The Developer's Guide to Unit Economics

Hrushikesh Pokala

Senior Software Engineer Lead at Equifax

Hrushikesh Pokala
Open session

World Congress 2026 North America

Building Stuff with GenAI - The Open Minded Workshop beyond OpenAI

Andreas Erben

CTO for Applied AI and Metaverse at daenet

Andreas Erben

Related videos

Running Secure Life Science Research at Scale using Hybrid GPU HPC and Kubernetes 🧬 thumbnail
24:23
WWC Europe 2026 • about 1 month ago

Running Secure Life Science Research at Scale using Hybrid GPU HPC and Kubernetes 🧬

Jeremy Murray

A Deep Dive on How To Leverage the NVIDIA GB200 for Ultra-Fast Training and Inference on Kubernetes thumbnail
32:19
WWC 2025 • 12 months ago

A Deep Dive on How To Leverage the NVIDIA GB200 for Ultra-Fast Training and Inference on Kubernetes

Kevin Klues

AI Factories at Scale thumbnail
24:26
WWC 2024 • almost 2 years ago

AI Factories at Scale

Thomas Schmidt

Building a Cloud Platform Where Everything is Just Another Kubernetes Resource thumbnail
28:49
WWC Europe 2026 • about 1 month ago

Building a Cloud Platform Where Everything is Just Another Kubernetes Resource

Patrick Koss

Fifty Shades of Kubernetes Autoscaling thumbnail
30:26
WWC 2023 • over 2 years ago

Fifty Shades of Kubernetes Autoscaling

Mario-Leander Reimer

Understanding Kubernetes in a visual way thumbnail
29:05
WWC Europe 2026 • about 1 month ago

Understanding Kubernetes in a visual way

Aurélie Vache

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.