> Markdown version of [/events/world-congress-2026-north-america/sessions/1753-your-thread-pool-is](https://www.wearedevelopers.com/events/world-congress-2026-north-america/sessions/1753-your-thread-pool-is). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Your Thread Pool Is Lying to You — Sizing Concurrency from Rate Limits and Latency, Not Guesswork


- **Event:** World Congress 2026 North America

## Description

Here's a scenario most API teams have lived through: you set a rate limit of 40 TPS, your downstream averages 2.3 seconds per call, and your executor tops out at 25 threads. The limiter is happily approving work. The pool can't actually run it. Throughput collapses and nobody can explain why, because every component looks correctly configured in isolation.
The root cause is that teams size thread pools, HTTP connection pools, and database pools independently — usually from defaults or past incidents — instead of from the relationship between them. The math isn't complicated. It's just rarely done.
This talk covers one formula and its consequences: in-flight work equals throughput times latency. We'll apply it to executor pools, HTTP client pools, database connection pools, and distributed limiter client pools. I'll show the configuration mistakes that create each mismatch, what the symptoms look like in production, and the sizing cascade that keeps the gates consistent with each other.
If you've ever stared at a dashboard where the rate limiter says everything is fine but p99 latency is through the roof, this talk is for you.


## Speaker

### [Ratul Ghosh](https://www.wearedevelopers.com/@ratul-ghosh)

Intuit, Tech lead and architect for GenOS platform


## Related talks at this congress

- [Designing APIs That Survive AI Agents at Scale](https://www.wearedevelopers.com/events/world-congress-2026-north-america/sessions/1714-designing-apis-that) — Phani Pendurthi
- [When Logging Becomes The Outage: Escaping the ECS Logging Trap](https://www.wearedevelopers.com/events/world-congress-2026-north-america/sessions/1670-when-logging-becomes) — Rahul Tanniru
- [Fault Tolerance and Consistency at Scale: Harnessing the Power of Distributed SQL Databases](https://www.wearedevelopers.com/events/world-congress-2026-north-america/sessions/1696-fault-tolerance-and) — Wei Hu
- [How to generate business value through performance optimizations](https://www.wearedevelopers.com/events/world-congress-2026-north-america/sessions/1686-how-to-generate) — Nikolai Sidiropulo

## Watch remotely

Can’t make it to San José? Watch this session live with Pro. You also get:

- All full videos, bookmarks, and playlists
- World Congress livestreams

[See pricing](https://www.wearedevelopers.com/pricing)

## Links

- [Get tickets](https://www.wearedevelopers.com/world-congress-north-america/tickets)