WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
World Congress 2026 Europe • Jul 10, 2026 • Session details

20 billion requests a week: Upgrading Twilio's API gateway at scale

Ainhoa Arruabarrena Ortiz , Mario Román Dono , Marius Obert

How do you safely upgrade a legacy API gateway handling 20 billion weekly requests? Discover Twilio's five-year modernization strategy that conquered extreme technical debt with zero major disruptions.

Pause
Mute Enter Fullscreen
#1 about 3 min

The origin of Twilio's API tech debt

Years of rapid exponential growth created an undocumented ingress infrastructure that struggled to scale reliably.

#2 about 3 min

Legacy infrastructure components and non-negotiable requirements

Replacing a sprawling fleet of instances and dual gateways required maintaining strict backwards compatibility for existing clients.

#3 about 3 min

Architecting a unified contract-driven API gateway

Adopting a single source of truth based on Open API specifications enabled a modular, Kubernetes-driven cellular architecture.

#4 about 5 min

Executing safe traffic routing using intermediate DNS

Weighted DNS records and infrastructure-as-code configurations allowed granular traffic splitting and immediate rollback capabilities during the transition.

#5 about 5 min

Real-world migration roadblocks and undocumented dependencies

Uncovering unexpected client dependencies like legacy non-SNI connections and specific JSON orderings complicated simple platform updates.

#6 about 3 min

Performance outcomes of regional routing and cellularity

Rebuilding the edge infrastructure yielded improved network latency, zero downtime deploys, and an elevated developer experience for internal product teams.

#7 about 3 min

Modernizing edge experiences for agentic AI architectures

The next phase focuses on transitioning legacy XML responses to idiomatic JSON interfaces to empower conversational AI integrations.

Matching moments

3:46 min

Managing technical debt while iterating on API infrastructure

Anto Anto · World Congress 2024

2:11 min

Executing massive cloud network migrations while maintaining live systems

Dana Lawson Dana Lawson +1 · World Congress 2026 Europe

6:44 min

Designing a resilient API gateway architecture

Lars Hesel Christensen +1 · LIVE

3:00 min

Refactoring a complex legacy monolith into microservices

Andrew Holway · LIVE

5:12 min

Addressing runtime migration specifics and future open source framework ambitions

Max Fischer Max Fischer +1 · World Congress 2026 Europe

1:33 min

Understanding technical debt and legacy application risks

Shaaf Syed Shaaf Syed · World Congress 2025

More from World Congress 2026 Europe

Building the Nervous System of AI - Michael Kagan (NVIDIA) thumbnail
29:17
about 2 months ago

Building the Nervous System of AI - Michael Kagan (NVIDIA)

Michael Kagan, Sead Ahmetović

Five Things in Tech that Matter Now - WeAreDevelopers World Congress 2026 Closing Keynote thumbnail
19:41
about 2 months ago

Five Things in Tech that Matter Now - WeAreDevelopers World Congress 2026 Closing Keynote

Christian Heilmann

The Sound of Your Secrets: Teaching Your Model to Spy, So You Can Learn to Defend thumbnail
32:06
about 2 months ago

The Sound of Your Secrets: Teaching Your Model to Spy, So You Can Learn to Defend

David vonThenen

Super scaling for the Super Bowl: How to survive 30 million users hitting your backend in 30 minutes thumbnail
35:13
about 2 months ago

Super scaling for the Super Bowl: How to survive 30 million users hitting your backend in 30 minutes

Irina Branovic

Running Secure Life Science Research at Scale using Hybrid GPU HPC and Kubernetes 🧬 thumbnail
24:23
about 2 months ago

Running Secure Life Science Research at Scale using Hybrid GPU HPC and Kubernetes 🧬

Jeremy Murray

Angstfreude - AI and Corporate Culture - The Thrill and the Threat thumbnail
30:26
about 2 months ago

Angstfreude - AI and Corporate Culture - The Thrill and the Threat

Axel Ebert, Karin Krobath

Upcoming sessions on this topic

Open session

World Congress 2026 North America

September 25, 2026 · 12:20–12:50

Stage 9

Designing APIs That Survive AI Agents at Scale

Phani Pendurthi

Mastercard, Principal Software Engineer

Phani Pendurthi
Open session

World Congress 2026 North America

September 24, 2026 · 11:00–11:30

Stage 2

From Stateless to Stateful: Real-Time Voice & Messaging Agents with Twilio and AWS

Rishab Kumar

Staff Developer Evangelist @ Twilio

Rishab Kumar
Open session

World Congress 2026 North America

September 25, 2026 · 09:40–10:10

Stage 3

Still on 4.8 or lower? A Practical Guide to Moving Your "Un-Migratable" .NET Apps

Isaac Levin

Developer Advocate

Isaac Levin
Open session

World Congress 2026 North America

September 24, 2026 · 14:10–14:40

Stage 7

Designing High-Performance AI APIs: Lessons from Serving Millions of Real-Time Requests

Wayne Liu

Chief Growth Officer and Americas President of Perfect Corp.

Wayne Liu
Open session

World Congress 2026 North America

September 24, 2026 · 17:30–18:00

Stage 4

Boring Failover: Predictable Region Recovery Across 5,000 Microservices

Garvit Kataria, Sahil Sabharwal

Garvit Kataria
Sahil Sabharwal
Open session

World Congress 2026 North America

September 24, 2026 · 14:10–14:40

Stage 1

Anatomy of an AI Request: Where Latency and Cost Are Really Born

Dan Fu

VP of Kernels at Together AI

Dan Fu

Related videos

API‑First: How Twilio Designs for Developers - Justin Kitagawa (Twilio) thumbnail
53:24
Coffee With Developers • 7 months ago

API‑First: How Twilio Designs for Developers - Justin Kitagawa (Twilio)

Justin Kitagawa

Throwing off the burdens of scale in engineering thumbnail
32:00
World Congress 2023 • about 3 years ago

Throwing off the burdens of scale in engineering

David Singleton, Thomas Pamminger

Lessons from Our API Past: Evolving to a Resilient API Future thumbnail
29:30
World Congress 2025 • about 1 year ago

Lessons from Our API Past: Evolving to a Resilient API Future

Yousaf Nabi

Seven Myths, Three Reasons, One Goal thumbnail
46:48
World Congress 2021 • about 5 years ago

Seven Myths, Three Reasons, One Goal

Stefan Priebsch

5 Years in Cloud Native: The Good, the Bad, and the Bill thumbnail
14:59
World Congress 2026 Europe • about 2 months ago

5 Years in Cloud Native: The Good, the Bad, and the Bill

Simone Desantis

The Velocity Tax: The Hidden Cost of Unintentional Feature Alignment thumbnail
23:51
World Congress 2026 Europe • 2 months ago

The Velocity Tax: The Hidden Cost of Unintentional Feature Alignment

Tushar Gupta

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.