World Congress 2025

Your Next AI Needs 10,000 GPUs. Now What?

July 10, 2025 13:30 โ€“ 14:00 ยท 30 min Stage 5

What this session covers

As Large Language Models become foundational to modern applications, the complexity of securing and managing the right GPU infrastructure is a critical bottleneck. This session demystifies GPU consumption at scale, from single-GPU setups to vast, multi-node clusters. We will then introduce NVIDIA DGX Cloud Lepton, a revolutionary AI platform and compute marketplace. Discover how Lepton connects developers to a global network of cloud partners, unlocking access to tens of thousands of GPUs to build the next generation of AI.

Key Takeaways:

  • GPU and multi-node system architectures for AI.
  • Navigating abstraction layers: Bare Metal, VMs, and Kubernetes.
  • Unifying access with the DGX Cloud Lepton compute marketplace.
  • Achieving location and vendor-agnostic AI deployment.

Related talks at this congress

Open session

World Congress 2025

July 11, 2025 ยท 13:00โ€“14:00

NVIDIA Lounge (Booth A16/17)

NVIDIA Expert Session: Your AI, Everywhere: Unifying Infrastructure for Unbounded Innovation

Anshul Jindal, Martin Piercy

Anshul Jindal
Martin Piercy
Open session

World Congress 2025

July 10, 2025 ยท 11:30โ€“12:00

Stage 7

A Deep Dive on How To Leverage the NVIDIA GB200 for Ultra-Fast Training and Inference on Kubernetes

Kevin Klues

Distinguished Engineer at NVIDIA

Kevin Klues
Open session

World Congress 2025

July 10, 2025 ยท 10:00โ€“11:00

NVIDIA Lounge (Booth A16/17)

NVIDIA Expert Session: Optimized Deployment of Large Language Models

Anshul Jindal, Kevin Klues, Martin Piercy

Anshul Jindal
Kevin Klues
Martin Piercy
Open session

World Congress 2025

July 11, 2025 ยท 15:40โ€“16:10

Stage 7

Unveiling the Magic: Scaling Large Language Models to Serve Millions

Patrick Koss

STACKIT, Tech Lead

Patrick Koss
All sessions at this congress