WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
World Congress 2026 North America • Sep 24, 2026 • Session details

Designing High-Performance AI APIs: Lessons from Serving Millions of Real-Time Requests

Wayne Liu

Wayne Liu warns that standard REST APIs fail under heavy AI inference. Discover how asynchronous, task-based orchestration seamlessly powers 200 million daily requests for retail giants.

Starting at 6:46 · Watch from the beginning

Designing High-Performance AI APIs: Lessons from Serving Millions of Real-Time Requests thumbnail

Checking access…

Playback and chapters load privately for Free videos.

Matching moments

5:58 min

Architecting inference layers and meta harnesses to manage token costs

Hari Lingamagunta Hari Lingamagunta +3 · World Congress 2026 North America

2:40 min

Understanding the relationship between APIs and AI

Hugo Guerrero Hugo Guerrero · World Congress 2024

2:14 min

Balancing AI investment with product shipping commitments

Ajita Kanchivakam Ananth Ajita Kanchivakam Ananth · World Congress 2026 North America

2:26 min

Cost and latency pressures pushing AI to the edge

Moe Sani Moe Sani · World Congress 2026 Europe

4:03 min

Balancing commercial limits and usage restrictions in AI

Antoine Thomas Antoine Thomas · Europe 2026 Virtual

2:41 min

Exploring modern AI SDKs and production deployment challenges

Michał Michalczuk Michał Michalczuk · Europe 2026 Virtual

More from World Congress 2026 North America

2026 in LLMs (so far) thumbnail
31:31

2026 in LLMs (so far)

Simon Willison · Datasette /Django

Running Operations Without Humans in the Loop thumbnail
32:31

Running Operations Without Humans in the Loop

Edward Aryee +4

Beyond the Code: Human-AI Synergies in Product Development thumbnail
17:43

Beyond the Code: Human-AI Synergies in Product Development

Ajita Kanchivakam Ananth · Google

Honey, look! I vibe-coded an OS! thumbnail
30:40

Honey, look! I vibe-coded an OS!

Ian Smith · LYOS

The Productivity Illusion: What AI Really Changed for Developers thumbnail
24:28

The Productivity Illusion: What AI Really Changed for Developers

Fatih Kadir Akın · WordPress/Automattic

Your Evals Passed. Your Agent Just Emptied a Database. thumbnail
21:37

Your Evals Passed. Your Agent Just Emptied a Database.

Tejas Pravinbhai Patel · Amazon

Upcoming sessions on this topic

Open session

Engineering AI Strategy: Beyond the Hype

  • Omkar Srivastava

    ADSK

    Engineering Leader

Open session

Build a Zero-Cost AI Agent in Your Browser

  • Aishwarya Mathuria

    Adobe

    Computer Scientist

  • Nishant Thakur

    Adobe

    Senior Computer Scientist

Open session

Built-In AI in the Browser: Practical Capabilities for Modern Web Apps

  • Piyush Gupta

    Expedia

    Senior Engineering Manager

Open session

AI Is the Easy Part: Why Faster Engineers Don't Make Faster Businesses

  • Bharat Sharma

    Booking

    Senior Engineering Manager

Open session

Your AI Agents Are Bleeding Tokens: Building a Runtime Cost Control Plane for LLMs

  • Aakriti Aggarwal

    IBM Research

    Research Engineer

  • Bhavishya Pandit

    66degrees

    Leading AI Innovation

Open session

Bypassing the GPU Tax: Smart Layer-7 Routing with Small Language Models (SLMs)

  • Sagar Utekar

    CrowdStrike

    SRE

Related videos

Anatomy of an AI Request: Where Latency and Cost Are Really Born thumbnail
28:01

Anatomy of an AI Request: Where Latency and Cost Are Really Born

Dan Fu · Together AI

World Congress North America · 2026

Headless by Design: Building Enterprise Systems That Agents Can Actually Use thumbnail
23:52

Headless by Design: Building Enterprise Systems That Agents Can Actually Use

Dirk Gronert · Salesforce

World Congress Europe · 2026

Bringing AI Everywhere thumbnail
26:25

Bringing AI Everywhere

Stephan Gillich · Intel

World Congress · 2024

AI That Fits Your Business, Not the Other Way Around thumbnail
25:56

AI That Fits Your Business, Not the Other Way Around

Anshul Jindal +1

World Congress Europe · 2026

Designing APIs That Survive AI Agents at Scale thumbnail
30:39

Designing APIs That Survive AI Agents at Scale

Phani Pendurthi · Mastercard

World Congress North America · 2026

Performance Engineering in the Age of AI thumbnail
24:49

Performance Engineering in the Age of AI

Frederic Branczyk · Dash0

World Congress North America · 2026

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.