WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
World Congress 2026 Europe • Jul 10, 2026 • Session details

20 billion requests a week: Upgrading Twilio's API gateway at scale

Ainhoa Arruabarrena Ortiz , Mario Román Dono , Marius Obert

How do you safely upgrade a legacy API gateway handling 20 billion weekly requests? Discover Twilio's five-year modernization strategy that conquered extreme technical debt with zero major disruptions.

Pause
Mute Enter Fullscreen
#1 about 3 min

The origin of Twilio's API tech debt

Years of rapid exponential growth created an undocumented ingress infrastructure that struggled to scale reliably.

#2 about 3 min

Legacy infrastructure components and non-negotiable requirements

Replacing a sprawling fleet of instances and dual gateways required maintaining strict backwards compatibility for existing clients.

#3 about 3 min

Architecting a unified contract-driven API gateway

Adopting a single source of truth based on Open API specifications enabled a modular, Kubernetes-driven cellular architecture.

#4 about 5 min

Executing safe traffic routing using intermediate DNS

Weighted DNS records and infrastructure-as-code configurations allowed granular traffic splitting and immediate rollback capabilities during the transition.

#5 about 5 min

Real-world migration roadblocks and undocumented dependencies

Uncovering unexpected client dependencies like legacy non-SNI connections and specific JSON orderings complicated simple platform updates.

#6 about 3 min

Performance outcomes of regional routing and cellularity

Rebuilding the edge infrastructure yielded improved network latency, zero downtime deploys, and an elevated developer experience for internal product teams.

#7 about 3 min

Modernizing edge experiences for agentic AI architectures

The next phase focuses on transitioning legacy XML responses to idiomatic JSON interfaces to empower conversational AI integrations.

Matching moments

3:46 min

Managing technical debt while iterating on API infrastructure

Anto Anto · World Congress 2024

2:11 min

Executing massive cloud network migrations while maintaining live systems

Dana Lawson Dana Lawson +1 · World Congress 2026 Europe

6:44 min

Designing a resilient API gateway architecture

Lars Hesel Christensen +1 · LIVE

3:00 min

Refactoring a complex legacy monolith into microservices

Andrew Holway · LIVE

5:12 min

Addressing runtime migration specifics and future open source framework ambitions

Max Fischer Max Fischer +1 · World Congress 2026 Europe

1:33 min

Understanding technical debt and legacy application risks

Shaaf Syed Shaaf Syed · World Congress 2025

More from World Congress 2026 Europe

Building the Nervous System of AI - Michael Kagan (NVIDIA) thumbnail
29:17
3 months ago

Building the Nervous System of AI - Michael Kagan (NVIDIA)

Michael Kagan, Sead Ahmetović

Five Things in Tech that Matter Now - WeAreDevelopers World Congress 2026 Closing Keynote thumbnail
19:41
3 months ago

Five Things in Tech that Matter Now - WeAreDevelopers World Congress 2026 Closing Keynote

Christian Heilmann

The Sound of Your Secrets: Teaching Your Model to Spy, So You Can Learn to Defend thumbnail
32:06
3 months ago

The Sound of Your Secrets: Teaching Your Model to Spy, So You Can Learn to Defend

David vonThenen

Super scaling for the Super Bowl: How to survive 30 million users hitting your backend in 30 minutes thumbnail
35:13
3 months ago

Super scaling for the Super Bowl: How to survive 30 million users hitting your backend in 30 minutes

Irina Branovic

Running Secure Life Science Research at Scale using Hybrid GPU HPC and Kubernetes 🧬 thumbnail
24:23
3 months ago

Running Secure Life Science Research at Scale using Hybrid GPU HPC and Kubernetes 🧬

Jeremy Murray

Angstfreude - AI and Corporate Culture - The Thrill and the Threat thumbnail
30:26
3 months ago

Angstfreude - AI and Corporate Culture - The Thrill and the Threat

Axel Ebert, Karin Krobath

Related videos

API‑First: How Twilio Designs for Developers - Justin Kitagawa (Twilio) thumbnail
53:24
Coffee With Developers • 8 months ago

API‑First: How Twilio Designs for Developers - Justin Kitagawa (Twilio)

Justin Kitagawa

Throwing off the burdens of scale in engineering thumbnail
32:00
World Congress 2023 • about 3 years ago

Throwing off the burdens of scale in engineering

David Singleton, Thomas Pamminger

Lessons from Our API Past: Evolving to a Resilient API Future thumbnail
29:30
World Congress 2025 • about 1 year ago

Lessons from Our API Past: Evolving to a Resilient API Future

Yousaf Nabi

Seven Myths, Three Reasons, One Goal thumbnail
46:48
World Congress 2021 • about 5 years ago

Seven Myths, Three Reasons, One Goal

Stefan Priebsch

5 Years in Cloud Native: The Good, the Bad, and the Bill thumbnail
14:59
World Congress 2026 Europe • 3 months ago

5 Years in Cloud Native: The Good, the Bad, and the Bill

Simone Desantis

The Velocity Tax: The Hidden Cost of Unintentional Feature Alignment thumbnail
23:51
World Congress 2026 Europe • 3 months ago

The Velocity Tax: The Hidden Cost of Unintentional Feature Alignment

Tushar Gupta

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.