WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
World Congress 2026 North America • Sep 25, 2026 • Session details

Scaling Distributed Queues for AI workloads

Jasmit Kaur Saluja

How does Meta process trillions of background tasks daily without wasting expensive GPU capacity? Unpack the distributed queue architecture powering their unpredictable AI workloads.

Scaling Distributed Queues for AI workloads thumbnail

Checking access…

Playback and chapters load privately for Free videos.

Matching moments

1:48 min

Managing asynchronous communications and load leveling

Paweł Siwek Paweł Siwek · World Congress 2025

2:07 min

SubmitQueue system architecture and operational scale at Uber

Manjari Akella Manjari Akella +1 · World Congress 2026 North America

2:30 min

Scaling backend infrastructure to support agentic AI workloads

Wei Hu Wei Hu · World Congress 2026 North America

2:53 min

Addressing system limitations and exploring future queue optimizations

Manjari Akella Manjari Akella +1 · World Congress 2026 North America

2:00 min

Reviewing key architectural decisions for federated AI computing

Jeremy Murray Jeremy Murray · World Congress 2026 Europe

2:49 min

Competing fundamentally through proficient AI orchestration and coordination

Przemysław Ładyński Przemysław Ładyński · World Congress 2026 Europe

More from World Congress 2026 North America

2026 in LLMs (so far) thumbnail
31:31
10 days ago

2026 in LLMs (so far)

Simon Willison

Running Operations Without Humans in the Loop thumbnail
32:31
10 days ago

Running Operations Without Humans in the Loop

Edward Aryee, Ryan Ries, Yaron Schneider, Chris Hallenbeck, Floriane Gramlich

Beyond the Code: Human-AI Synergies in Product Development thumbnail
17:43
10 days ago

Beyond the Code: Human-AI Synergies in Product Development

Ajita Kanchivakam Ananth

Honey, look! I vibe-coded an OS! thumbnail
30:40
10 days ago

Honey, look! I vibe-coded an OS!

Ian Smith

The Productivity Illusion: What AI Really Changed for Developers thumbnail
24:28
10 days ago

The Productivity Illusion: What AI Really Changed for Developers

Fatih Kadir Akın

Your Evals Passed. Your Agent Just Emptied a Database. thumbnail
21:37
10 days ago

Your Evals Passed. Your Agent Just Emptied a Database.

Tejas Pravinbhai Patel

Related videos

What is a Message Queue and when and why would I use it? thumbnail
45:36
World Congress 2022 • over 4 years ago

What is a Message Queue and when and why would I use it?

Clemens Vasters

Real-Time Data Platforms at Trillion-Event Scale thumbnail
26:39
World Congress 2026 North America • 11 days ago

Real-Time Data Platforms at Trillion-Event Scale

Diptamay Sanyal

The Gashlycrumb Tinies of AI Networking You Must Know (or Languish!) thumbnail
28:19
Europe 2026 Virtual • 3 months ago

The Gashlycrumb Tinies of AI Networking You Must Know (or Languish!)

Lerna Ekmekcioglu

Running Secure Life Science Research at Scale using Hybrid GPU HPC and Kubernetes 🧬 thumbnail
24:23
World Congress 2026 Europe • 3 months ago

Running Secure Life Science Research at Scale using Hybrid GPU HPC and Kubernetes 🧬

Jeremy Murray

Anatomy of an AI Request: Where Latency and Cost Are Really Born thumbnail
28:01
World Congress 2026 North America • 11 days ago

Anatomy of an AI Request: Where Latency and Cost Are Really Born

Dan Fu

DevOps for AI: running LLMs in production with Kubernetes and KubeFlow thumbnail
34:21
LIVE • about 2 years ago

DevOps for AI: running LLMs in production with Kubernetes and KubeFlow

Aarno Aukia

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.