> Markdown version of [/videos/100473-scaling-distributed-queues-for-ai-workloads](https://www.wearedevelopers.com/videos/100473-scaling-distributed-queues-for-ai-workloads). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Scaling Distributed Queues for AI workloads

How does Meta process trillions of background tasks daily without wasting expensive GPU capacity? Unpack the distributed queue architecture powering their unpredictable AI workloads.

- **Speakers:** [Jasmit Kaur Saluja](https://www.wearedevelopers.com/@jasmit-kaur-saluja)
- **Event:** World Congress 2026 North America
- **Published:** September 25, 2026
- **Duration:** 22:58
- **URL:** https://www.wearedevelopers.com/videos/100473-scaling-distributed-queues-for-ai-workloads

## Access

Playback and chapters for this video are available with a Free account.

## Related Moments

- [Managing asynchronous communications and load leveling](https://www.wearedevelopers.com/videos/1529-azure-well-architected-framework-designing-mission-critical-workloads-in-practice) (from "Azure-Well Architected Framework - designing mission critical workloads in practice")
- [SubmitQueue system architecture and operational scale at Uber](https://www.wearedevelopers.com/videos/100480-merging-at-scale-from-broken-builds-to-green-mainline) (from "Merging at Scale: From Broken Builds to Green Mainline")
- [Scaling backend infrastructure to support agentic AI workloads](https://www.wearedevelopers.com/videos/100481-fault-tolerance-and-consistency-at-scale-harnessing-the-power-of-distributed-sql-databases) (from "Fault Tolerance and Consistency at Scale: Harnessing the Power of Distributed SQL Databases")
- [Addressing system limitations and exploring future queue optimizations](https://www.wearedevelopers.com/videos/100480-merging-at-scale-from-broken-builds-to-green-mainline) (from "Merging at Scale: From Broken Builds to Green Mainline")
- [Reviewing key architectural decisions for federated AI computing](https://www.wearedevelopers.com/videos/100355-running-secure-life-science-research-at-scale-using-hybrid-gpu-hpc-and-kubernetes) (from "Running Secure Life Science Research at Scale using Hybrid GPU HPC and Kubernetes 🧬")
- [Competing fundamentally through proficient AI orchestration and coordination](https://www.wearedevelopers.com/videos/100200-best-practices-for-ai-assisted-development-of-distributed-systems) (from "Best Practices for AI-Assisted Development of Distributed Systems")

## Related Articles

- [Stephan Gillich - Bringing AI Everywhere](https://www.wearedevelopers.com/magazine/489-stephan-gillich-bringing-ai-everywhere)
- [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development)
- [ I Gave a Video Editor More Autonomy Than a Trading Bot. On Purpose.](https://www.wearedevelopers.com/magazine/773-i-gave-a-video-editor-more-autonomy-than-a-trading-bot-on-purpose)
- [MLops – Deploying, Maintaining And Evolving Machine Learning Models in Production](https://www.wearedevelopers.com/magazine/115-mlops-deploying-maintaining-and-evolving-machine-learning-models-in-production)

## Related Jobs

- [Senior AI/ML Engineer](https://www.wearedevelopers.com/jobs/48352-senior-ai-ml-engineer) at **PagerDuty**
- [Senior AI Serving Engineer, Backend](https://www.wearedevelopers.com/jobs/48414-senior-ai-serving-engineer-backend) at **Sciforium**
- [ML Engineer](https://www.wearedevelopers.com/jobs/48422-ml-engineer) at **Sciforium**
- [LLM Training Engineer](https://www.wearedevelopers.com/jobs/48420-llm-training-engineer) at **Sciforium**
- [Lead Software Engineer, Model Serving Platform](https://www.wearedevelopers.com/jobs/48413-lead-software-engineer-model-serving-platform) at **Sciforium**
- [Software Engineer, Fullstack](https://www.wearedevelopers.com/jobs/48415-software-engineer-fullstack) at **Sciforium**