Designing High-Performance AI APIs: Lessons from Serving Millions of Real-Time Requests
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Wayne Liu warns that standard REST APIs fail under heavy AI inference. Discover how asynchronous, task-based orchestration seamlessly powers 200 million daily requests for retail giants.
Checking access…
Playback and chapters load privately for Free videos.
Matching moments
More from World Congress 2026 North America
Related videos
Related articles
DC
Daniel Cranney
BB
Benedikt Bischof
BB
Benedikt Bischof
BR
Benjamin Ruschin
From learning to earning
Jobs that call for the skills explored in this talk.
26 days ago
Principal Software Engineer, AI Inference Cloud
ARM
Seattle, WA, United States
Expert
$262k
Pytorch
TensorRT
Kubernetes
26 days ago
Staff Software Engineer, AI Inference Cloud
ARM
Seattle, WA, United States
Expert
$209k–282k
Pytorch
TensorRT
Kubernetes
26 days ago
Principal Software Engineer, AI Inference Runtime
ARM
Seattle, WA, United States
Expert
$262k
Compilers
Low Latency
Concurrency
27 days ago
Senior AI Developer
PwC
United States
Expert
Remote
Docker
Github
Fastapi
26 days ago
Principal Software Engineer, AI Compute Platform
ARM
Seattle, WA, United States
Expert
$262k
Backend
Grafana
Pytorch
5 days ago
Director, AI & Data Solution Architect
PwC
Las Vegas, NV, United States
Expert
$155k
AI Platforms
Data Systems
Generative AI