WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
World Congress 2026 Europe - Virtual Stage • Jul 2, 2026 • Session details

The Gashlycrumb Tinies of AI Networking You Must Know (or Languish!)

Lerna Ekmekcioglu

Distributed AI training is a fragile seance where one dropped connection crashes the entire process. Discover how to eliminate network stragglers and build fault-tolerant GPU clusters at scale.

Pause
Mute Enter Fullscreen
#1 about 4 min

The AI workload technology stack and its components

The AI infrastructure stack relies on interconnected machine learning frameworks and network libraries to execute distributed operations.

#2 about 5 min

Anatomy of a distributed AI training loop in Kubernetes

Orchestrating tools execute forward passes, backward passes, and optimization steps across multiple containerized nodes.

#3 about 2 min

Strategies for scaling AI workloads across multiple GPUs

Data, tensor, and pipeline parallelism strategies divide compute tasks to optimize processing across massive hardware clusters.

#4 about 2 min

Coordinating GPU communication with NVIDIA collective communications library

Collective operations manage hardware topology and data synchronization to ensure model coherence across parallel operations.

#5 about 5 min

How slow queue pairs degrade AI training job throughput

High-latency network paths delay synchronization cycles and drastically reduce hardware utilization efficiency.

#6 about 4 min

Comparing backend and frontend networks for AI workloads

Dedicated architectures separate low-latency compute traffic from standard general-purpose management connectivity.

#7 about 2 min

Bypassing the CPU stack with remote direct memory access

Hardware-accelerated protocols transfer data directly between device memory blocks to eliminate kernel bottleneck latencies.

#8 about 5 min

Impact of network link flapping on distributed training jobs

Transient physical hardware disconnections immediately crash synchronous distributed machine learning sessions.

#9 about 4 min

Mitigating failure impact through regular AI model checkpointing

Persisting model state to storage at regular step boundaries prevents complete data loss during infrastructure outages.

Matching moments

3:05 min

Acquiring Mellanox to build cohesive AI factories

Michael Kagan Michael Kagan +1 · WWC Europe 2026

3:28 min

Challenges of shared Kubernetes clusters for AI workloads

Piotr Zaniewski Piotr Zaniewski · WWC Europe 2026

2:51 min

Designing hardware infrastructure and networking for distributed compute

Anshul Jindal Anshul Jindal +1 · WWC 2025

4:26 min

Five unique failure modes in production AI systems

Heather Thacker Heather Thacker · Europe 2026 Virtual

1:38 min

Scaling bottlenecks in generative AI applications

Stan Girard Stan Girard · WWC 2024

5:27 min

Simulating AI system cascades and graceful load shedding

Heather Thacker Heather Thacker · Europe 2026 Virtual

More from World Congress 2026 Europe - Virtual Stage

One Does Not Simply Make Architecture Decisions Alone thumbnail
36:15
29 days ago

One Does Not Simply Make Architecture Decisions Alone

Vladas Diržys

From Black Box to Glass Box : Bedrock AgentCore Observability thumbnail
21:15
about 1 month ago

From Black Box to Glass Box : Bedrock AgentCore Observability

Yasemin Aktürk

Leading in Rhythm: How Women Make Better Decisions with Biological Intelligence thumbnail
30:41
about 1 month ago

Leading in Rhythm: How Women Make Better Decisions with Biological Intelligence

Julia Grosse

Better Together: Leveraging Your Observability Tools as a SIEM thumbnail
39:06
about 1 month ago

Better Together: Leveraging Your Observability Tools as a SIEM

Mathias Palmersheim

ChatGPT Apps: From Chat to Checkout thumbnail
30:29
about 1 month ago

ChatGPT Apps: From Chat to Checkout

Aaron Koivunen

Interior Decorating (TypeScript Decorators) thumbnail
29:22
about 1 month ago

Interior Decorating (TypeScript Decorators)

Michael Dowden

Upcoming sessions on this topic

Open session

World Congress 2026 North America

Trust, But Verify: Continuous GPU Validation at Scale

Kyle Bell

VP of AI @ TensorWave

Kyle Bell
Open session

World Congress 2026 North America

Agents That Own Their Inference: Building Production AI Agents on Dedicated GPUs

Duan Lightfoot

Sr. AI Engineer, Akamai

Duan Lightfoot
Open session

World Congress 2026 North America

No Single Model to Rule Them All: Building Resilient AI Agents Across Open & Closed LLMs

Emmanuel Acheampong

Senior Manager Developer Relations at Crusoe AI

Emmanuel Acheampong
Open session

World Congress 2026 North America

You Can’t Re-Run Sunlight: Designing ML Data Architectures for Physical AI

An Phan

Senior Data Infrastructure Engineer @ Hippo Harvest

An Phan
Open session

World Congress 2026 North America

Compute for your AI model: GPUs, LPUs, TPUs and beyond..

Kushaagra Goyal

Tech Lead at Rubrik, ex-CTO at Gan.AI, ex-Databricks

Kushaagra Goyal
Open session

World Congress 2026 North America

Autonomous Infrastructure: Building AI Agents for Global-Scale Capacity Efficiency

Tommy Tran, Gregoire Colin

Tommy Tran
Gregoire Colin

Related videos

Building the Nervous System of AI - Michael Kagan (NVIDIA) thumbnail
29:17
WWC Europe 2026 • about 1 month ago

Building the Nervous System of AI - Michael Kagan (NVIDIA)

Michael Kagan, Sead Ahmetović

Your Next AI Needs 10,000 GPUs. Now What? thumbnail
29:52
WWC 2025 • 12 months ago

Your Next AI Needs 10,000 GPUs. Now What?

Anshul Jindal, Martin Piercy

AI Factories at Scale thumbnail
24:26
WWC 2024 • almost 2 years ago

AI Factories at Scale

Thomas Schmidt

Load Testing AI: Aiming at a Moving Target thumbnail
37:05
Europe 2026 Virtual • about 1 month ago

Load Testing AI: Aiming at a Moving Target

Heather Thacker

30 Golden Rules of Deep Learning Performance thumbnail
46:30
LIVE • about 6 years ago

30 Golden Rules of Deep Learning Performance

Anirudh Koul

A Deep Dive on How To Leverage the NVIDIA GB200 for Ultra-Fast Training and Inference on Kubernetes thumbnail
32:19
WWC 2025 • 12 months ago

A Deep Dive on How To Leverage the NVIDIA GB200 for Ultra-Fast Training and Inference on Kubernetes

Kevin Klues

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.