World Congress 2026 North America • Sep 24, 2026 • Session details

Designing High-Performance AI APIs: Lessons from Serving Millions of Real-Time Requests

Wayne Liu

Wayne Liu warns that standard REST APIs fail under heavy AI inference. Discover how asynchronous, task-based orchestration seamlessly powers 200 million daily requests for retail giants.

Designing High-Performance AI APIs: Lessons from Serving Millions of Real-Time Requests thumbnail

Checking access…

Playback and chapters load privately for Free videos.

Matching moments

5:58 min

Architecting inference layers and meta harnesses to manage token costs

Hari Lingamagunta Hari Lingamagunta +3 · World Congress 2026 North America

2:40 min

Understanding the relationship between APIs and AI

Hugo Guerrero Hugo Guerrero · World Congress 2024

2:14 min

Balancing AI investment with product shipping commitments

Ajita Kanchivakam Ananth Ajita Kanchivakam Ananth · World Congress 2026 North America

2:26 min

Cost and latency pressures pushing AI to the edge

Moe Sani Moe Sani · World Congress 2026 Europe

4:03 min

Balancing commercial limits and usage restrictions in AI

Antoine Thomas Antoine Thomas · Europe 2026 Virtual

2:41 min

Exploring modern AI SDKs and production deployment challenges

Michał Michalczuk Michał Michalczuk · Europe 2026 Virtual