World Congress 2024 • Aug 22, 2024 • Session details

Performant Architecture for a Fast Gen AI User Experience

Nathaniel Okenwa

Multi-second latency ruins real-time voice apps. Stop relying on naive batch processing. Discover how semantic chunking and edge models combine to deliver instantaneous generative AI experiences.

Performant Architecture for a Fast Gen AI User Experience thumbnail

Checking access…

Playback and chapters load privately for Free videos.

Matching moments

1:22 min

Leveraging the comprehensive generative artificial intelligence stack

Duan Lightfoot Duan Lightfoot · World Congress 2024

1:10 min

Architecting a web real-time communication stack for agents

Nathaniel Okenwa Nathaniel Okenwa · World Congress 2025

5:28 min

Integrating OpenAI for real-time streaming responses

Chris Heilmann Chris Heilmann +3 · LIVE

4:03 min

Enhancing conversational output via generative AI models

Xavier Portilla Edo · LIVE

4:16 min

Addressing latency and architecture in voice agents

Chris Heilmann Chris Heilmann +2 · LIVE

1:38 min

Scaling bottlenecks in generative AI applications

Stan Girard Stan Girard · World Congress 2024

Upcoming sessions on this topic

Open session

Build a Zero-Cost AI Agent in Your Browser

  • Aishwarya Mathuria

    Adobe

    Computer Scientist

  • Nishant Thakur

    Adobe

    Senior Computer Scientist

Open session

Bypassing the GPU Tax: Smart Layer-7 Routing with Small Language Models (SLMs)

  • Sagar Utekar

    CrowdStrike

    SRE

Open session

Built-In AI in the Browser: Practical Capabilities for Modern Web Apps

  • Piyush Gupta

    Expedia

    Senior Engineering Manager

Open session

Engineering AI Strategy: Beyond the Hype

  • Omkar Srivastava

    ADSK

    Engineering Leader

Open session

React Under Fire: Rendering Performance for Streaming Agent UIs

  • Abhirupa Mitra

    Slack

    Senior Member of Technical Staff

Open session

Enterprise AI Memory at Scale

  • Aditya Joshi

    Walmart

    Senior Software Engineer