> Markdown version of [/events/world-congress-2026-north-america/sessions/1777-scaling-distributed](https://www.wearedevelopers.com/events/world-congress-2026-north-america/sessions/1777-scaling-distributed). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Scaling Distributed Queues for AI workloads


- **Event:** World Congress 2026 North America

## Description

Almost every asynchronous action at Meta passes through a single system most people have never heard of. The Facebook Ordered Queueing Service (FOQS), a fully managed, horizontally scalable priority queue, moves close to a trillion items per day for 300+ engineering teams, and it has become critical infrastructure for AI at Meta's scale. Async LLM inference, Llama serving, GenAI image generation, and AI compute demand control all ride on it.

This talk traces how a queue originally built to absorb massive backlogs and prioritize work across highly heterogeneous producers and consumers grew into the reliability layer beneath Meta's AI stack supporting critical use cases like Ads, Integrity, AI Training and Whatsapp message delivery. 
It explains how one system came to serve hundreds of teams without them stepping on each other, how it keeps the most important work moving under enormous load, and how it evolved from isolated regional deployments into a globally distributed service that delivers region-level disaster recovery in seconds with zero client-visible downtime. The finale looks at how that same queue now acts as a control plane for shaping AI compute demand.

## Speaker

### [Jasmit Kaur Saluja](https://www.wearedevelopers.com/@jasmit-kaur-saluja)

Software Engineer @Meta Platforms Inc


## Related talks at this congress

- [No Single Model to Rule Them All: Building Resilient AI Agents Across Open & Closed LLMs](https://www.wearedevelopers.com/events/world-congress-2026-north-america/sessions/1671-no-single-model-to) — Emmanuel Acheampong
- [AI Agents are Only as Smart as their Context: Building a Real-Time Context Engine at Intuit](https://www.wearedevelopers.com/events/world-congress-2026-north-america/sessions/1736-ai-agents-are-only) — Bharat Patel
- [Look What Java Can Do Now: Live-Coding a GenAI MCP Server with the JAQ Stack](https://www.wearedevelopers.com/events/world-congress-2026-north-america/sessions/1421-look-what-java-can) — Suren Konathala
- [Autonomous Infrastructure: Building AI Agents for Global-Scale Capacity Efficiency](https://www.wearedevelopers.com/events/world-congress-2026-north-america/sessions/1403-autonomous) — Tommy Tran

## Watch remotely

Can’t make it to San José? Watch this session live with Pro. You also get:

- All full videos, bookmarks, and playlists
- World Congress livestreams

[See pricing](https://www.wearedevelopers.com/pricing)

## Links

- [Get tickets](https://www.wearedevelopers.com/world-congress-north-america/tickets)