World Congress 2025

Your Next AI Needs 10,000 GPUs. Now What?

July 10, 2025 13:30 โ€“ 14:00 ยท 30 min Stage 5

What this session covers

As Large Language Models become foundational to modern applications, the complexity of securing and managing the right GPU infrastructure is a critical bottleneck. This session demystifies GPU consumption at scale, from single-GPU setups to vast, multi-node clusters. We will then introduce NVIDIA DGX Cloud Lepton, a revolutionary AI platform and compute marketplace. Discover how Lepton connects developers to a global network of cloud partners, unlocking access to tens of thousands of GPUs to build the next generation of AI.

Key Takeaways:

  • GPU and multi-node system architectures for AI.
  • Navigating abstraction layers: Bare Metal, VMs, and Kubernetes.
  • Unifying access with the DGX Cloud Lepton compute marketplace.
  • Achieving location and vendor-agnostic AI deployment.

World Congress 2025

Related talks

Open session

NVIDIA Expert Session: Your AI, Everywhere: Unifying Infrastructure for Unbounded Innovation

  • Anshul Jindal

    NVIDIA

    Sr. Solution Architect

  • Martin Piercy

    NVIDIA

    Solutions Architect

Open session

A Deep Dive on How To Leverage the NVIDIA GB200 for Ultra-Fast Training and Inference on Kubernetes

  • Kevin Klues

    NVIDIA

    Distinguished Engineer

Open session

NVIDIA Expert Session: Optimized Deployment of Large Language Models

  • Anshul Jindal

    NVIDIA

    Sr. Solution Architect

  • Kevin Klues

    NVIDIA

    Distinguished Engineer

  • Martin Piercy

    NVIDIA

    Solutions Architect

Open session

Unveiling the Magic: Scaling Large Language Models to Serve Millions

  • Patrick Koss

    STACKIT

    Tech Lead

All sessions at this congress