Your Thread Pool Is Lying to You β Sizing Concurrency from Rate Limits and Latency, Not Guesswork
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Oversized thread pool queues don't absorb bursts, they just convert them into hidden latency. Learn the exact math to correctly size your backend concurrency and protect throughput.
Checking accessβ¦
Playback and chapters load privately for Free videos.
Matching moments
More from World Congress 2026 North America
Upcoming sessions on this topic
Starts in 5 days
Conference India 2026
November 25β26, 2026
Bengaluru, India
-
How We Cut Our API's p99 Latency from Minutes to Under a Second
Deepak Agrawal Β· Atlassian
Wed 25 Nov Β· Stage 2
-
How 8 GPUs Became 16: Rethinking LLM Inference Through Parallelism, Memory, and Runtime Design
Purnima Kumari Β· DigitalOCean
Thu 26 Nov Β· Stage 2
-
AI Is the Easy Part: Why Faster Engineers Don't Make Faster Businesses
Bharat Sharma Β· Booking
Wed 25 Nov Β· Mainstage
Related videos
Related articles
From learning to earning
Jobs that call for the skills explored in this talk.
22 days ago
Staff Software Engineer, Traffic Team
GitHub
Beverly Hills, CA, United States
Experienced
Remote
Ddos
Ruby
Golang
18 days ago
β’
Software Development Engineer 1
WEX
Bengaluru, India
Starter
Hybrid Β· 3 days on-site
Java
Spring
18 days ago
β’
Software Development Engineer 1
WEX
Bengaluru, India
Starter
Hybrid Β· 3 days on-site
Java
15 days ago
Software Engineer L3 Email
Twilio
Beverly Hills, CA, United States
Experienced
$138kβ173k
Remote
Golang
Docker
Twilio
18 days ago
β’
Director of Engineering - Data Platform SDM5
WEX
Bengaluru, India
Expert
Hybrid Β· 3 days on-site
ETL
Spark
Java EE
10 days ago
Principal Software Engineer, Copilot Code Review
GitHub
Beverly Hills, CA, United States
Expert
Remote
Ruby
Golang
Github