WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
World Congress 2026 North America • Sep 25, 2026 • Session details

Scaling Distributed Queues for AI workloads

Jasmit Kaur Saluja

How does Meta process trillions of background tasks daily without wasting expensive GPU capacity? Unpack the distributed queue architecture powering their unpredictable AI workloads.

Starting at 3:44 · Watch from the beginning

Scaling Distributed Queues for AI workloads thumbnail

Checking access…

Playback and chapters load privately for Free videos.

Matching moments

1:48 min

Managing asynchronous communications and load leveling

Paweł Siwek Paweł Siwek · World Congress 2025

2:07 min

SubmitQueue system architecture and operational scale at Uber

Manjari Akella Manjari Akella +1 · World Congress 2026 North America

2:30 min

Scaling backend infrastructure to support agentic AI workloads

Wei Hu Wei Hu · World Congress 2026 North America

2:53 min

Addressing system limitations and exploring future queue optimizations

Manjari Akella Manjari Akella +1 · World Congress 2026 North America

2:00 min

Reviewing key architectural decisions for federated AI computing

Jeremy Murray Jeremy Murray · World Congress 2026 Europe

2:49 min

Competing fundamentally through proficient AI orchestration and coordination

Przemysław Ładyński Przemysław Ładyński · World Congress 2026 Europe

More from World Congress 2026 North America

2026 in LLMs (so far) thumbnail
31:31

2026 in LLMs (so far)

Simon Willison · Datasette /Django

Running Operations Without Humans in the Loop thumbnail
32:31

Running Operations Without Humans in the Loop

Edward Aryee +4

Beyond the Code: Human-AI Synergies in Product Development thumbnail
17:43

Beyond the Code: Human-AI Synergies in Product Development

Ajita Kanchivakam Ananth · Google

Honey, look! I vibe-coded an OS! thumbnail
30:40

Honey, look! I vibe-coded an OS!

Ian Smith · LYOS

The Productivity Illusion: What AI Really Changed for Developers thumbnail
24:28

The Productivity Illusion: What AI Really Changed for Developers

Fatih Kadir Akın · WordPress/Automattic

Your Evals Passed. Your Agent Just Emptied a Database. thumbnail
21:37

Your Evals Passed. Your Agent Just Emptied a Database.

Tejas Pravinbhai Patel · Amazon

Upcoming sessions on this topic

Open session

Bypassing the GPU Tax: Smart Layer-7 Routing with Small Language Models (SLMs)

  • Sagar Utekar

    CrowdStrike

    SRE

Open session

Lessons learned after 6.7T events through PostgreSQL queues

  • Mihir Gandhi

    Backend Engineer at RudderStack

Open session

How We Cut Our API's p99 Latency from Minutes to Under a Second

  • Deepak Agrawal

    Atlassian

    Principal Software Engineer

Open session

Enterprise AI Memory at Scale

  • Aditya Joshi

    Walmart

    Senior Software Engineer

Open session

Engineering AI Strategy: Beyond the Hype

  • Omkar Srivastava

    ADSK

    Engineering Leader

Open session

AI Is the Easy Part: Why Faster Engineers Don't Make Faster Businesses

  • Bharat Sharma

    Booking

    Senior Engineering Manager

Related videos

What is a Message Queue and when and why would I use it? thumbnail
45:36

What is a Message Queue and when and why would I use it?

Clemens Vasters · Microsoft

World Congress · 2022

Real-Time Data Platforms at Trillion-Event Scale thumbnail
26:39

Real-Time Data Platforms at Trillion-Event Scale

Diptamay Sanyal

World Congress North America · 2026

The Gashlycrumb Tinies of AI Networking You Must Know (or Languish!) thumbnail
28:19

The Gashlycrumb Tinies of AI Networking You Must Know (or Languish!)

Lerna Ekmekcioglu · Clockwork.io

Europe Virtual · 2026

Running Secure Life Science Research at Scale using Hybrid GPU HPC and Kubernetes 🧬 thumbnail
24:23

Running Secure Life Science Research at Scale using Hybrid GPU HPC and Kubernetes 🧬

Jeremy Murray · Stack8s

World Congress Europe · 2026

Anatomy of an AI Request: Where Latency and Cost Are Really Born thumbnail
28:01

Anatomy of an AI Request: Where Latency and Cost Are Really Born

Dan Fu · Together AI

World Congress North America · 2026

DevOps for AI: running LLMs in production with Kubernetes and KubeFlow thumbnail
34:21

DevOps for AI: running LLMs in production with Kubernetes and KubeFlow

Aarno Aukia

LIVE · Oct 2024

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.