> Markdown version of [/videos/100473-scaling-distributed-queues-for-ai-workloads?t=224](https://www.wearedevelopers.com/videos/100473-scaling-distributed-queues-for-ai-workloads?t=224). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Scaling Distributed Queues for AI workloads

How does Meta process trillions of background tasks daily without wasting expensive GPU capacity? Unpack the distributed queue architecture powering their unpredictable AI workloads.

- **Speakers:** [Jasmit Kaur Saluja](https://www.wearedevelopers.com/@jasmit-kaur-saluja)
- **Event:** World Congress 2026 North America
- **Published:** September 25, 2026
- **Duration:** 22:58
- **URL:** https://www.wearedevelopers.com/videos/100473-scaling-distributed-queues-for-ai-workloads
- **Thumbnail URL:** https://customer-goifxnzhrq3d0d54.cloudflarestream.com/f0e97a86d5ef2a71d223c7f3777a5054/thumbnails/thumbnail.jpg?time=226590ms

## Access

Playback and chapters for this video are available with a Free account.

## Related Moments

- [Managing asynchronous communications and load leveling](https://www.wearedevelopers.com/videos/1529-azure-well-architected-framework-designing-mission-critical-workloads-in-practice) (from "Azure-Well Architected Framework - designing mission critical workloads in practice")
  - **Thumbnail URL:** https://customer-goifxnzhrq3d0d54.cloudflarestream.com/b64c0c99279700fdc336c58a17624234/thumbnails/thumbnail.jpg?time=262495ms
- [SubmitQueue system architecture and operational scale at Uber](https://www.wearedevelopers.com/videos/100480-merging-at-scale-from-broken-builds-to-green-mainline) (from "Merging at Scale: From Broken Builds to Green Mainline")
  - **Thumbnail URL:** https://customer-goifxnzhrq3d0d54.cloudflarestream.com/05ab2123612bd1627282e7a35a9913cf/thumbnails/thumbnail.jpg?time=86221ms
- [Scaling backend infrastructure to support agentic AI workloads](https://www.wearedevelopers.com/videos/100481-fault-tolerance-and-consistency-at-scale-harnessing-the-power-of-distributed-sql-databases) (from "Fault Tolerance and Consistency at Scale: Harnessing the Power of Distributed SQL Databases")
  - **Thumbnail URL:** https://customer-goifxnzhrq3d0d54.cloudflarestream.com/d0fac30fc7c5d2524babe18983cedf4a/thumbnails/thumbnail.jpg?time=137376ms
- [Addressing system limitations and exploring future queue optimizations](https://www.wearedevelopers.com/videos/100480-merging-at-scale-from-broken-builds-to-green-mainline) (from "Merging at Scale: From Broken Builds to Green Mainline")
  - **Thumbnail URL:** https://customer-goifxnzhrq3d0d54.cloudflarestream.com/05ab2123612bd1627282e7a35a9913cf/thumbnails/thumbnail.jpg?time=86221ms
- [Reviewing key architectural decisions for federated AI computing](https://www.wearedevelopers.com/videos/100355-running-secure-life-science-research-at-scale-using-hybrid-gpu-hpc-and-kubernetes) (from "Running Secure Life Science Research at Scale using Hybrid GPU HPC and Kubernetes 🧬")
  - **Thumbnail URL:** https://customer-goifxnzhrq3d0d54.cloudflarestream.com/acfa629bdeb8c7ecf933b16772e0f7f5/thumbnails/thumbnail.jpg?time=85280ms
- [Competing fundamentally through proficient AI orchestration and coordination](https://www.wearedevelopers.com/videos/100200-best-practices-for-ai-assisted-development-of-distributed-systems) (from "Best Practices for AI-Assisted Development of Distributed Systems")
  - **Thumbnail URL:** https://customer-goifxnzhrq3d0d54.cloudflarestream.com/2c60f5bd1b51efff84bea148ad05724c/thumbnails/thumbnail.jpg?time=94870ms

## Related Articles

- [Stephan Gillich - Bringing AI Everywhere](https://www.wearedevelopers.com/magazine/489-stephan-gillich-bringing-ai-everywhere)
- [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development)
- [ I Gave a Video Editor More Autonomy Than a Trading Bot. On Purpose.](https://www.wearedevelopers.com/magazine/773-i-gave-a-video-editor-more-autonomy-than-a-trading-bot-on-purpose)
- [MLops – Deploying, Maintaining And Evolving Machine Learning Models in Production](https://www.wearedevelopers.com/magazine/115-mlops-deploying-maintaining-and-evolving-machine-learning-models-in-production)

## Related Jobs

- [Principal Software Engineer, AI Compute Platform](https://www.wearedevelopers.com/jobs/ext/3912651-principal-software-engineer-ai-compute-platform) at **ARM**
- [Principal Software Engineer, AI Inference Cloud](https://www.wearedevelopers.com/jobs/ext/3934814-principal-software-engineer-ai-inference-cloud) at **ARM**
- [Senior Data & AI Architect](https://www.wearedevelopers.com/jobs/48602-senior-data-ai-architect) at **reeeliance IM GmbH**
- [Principal Software Engineer, AI Compute Infrastructure](https://www.wearedevelopers.com/jobs/ext/3912650-principal-software-engineer-ai-compute-infrastructure) at **ARM**
- [Staff Software Engineer, AI Compute Platform](https://www.wearedevelopers.com/jobs/ext/3928542-staff-software-engineer-ai-compute-platform) at **ARM**
- [Senior AI Engineer (all genders welcome) - Developer Productivity & SDLC](https://www.wearedevelopers.com/jobs/ext/4042368-senior-ai-engineer-all-genders-welcome-developer-productivity-sdlc) at **Rosenxt Group**