World Congress 2024 • Aug 22, 2024 • Session details

Performant Architecture for a Fast Gen AI User Experience

Nathaniel Okenwa

Multi-second latency ruins real-time voice apps. Stop relying on naive batch processing. Discover how semantic chunking and edge models combine to deliver instantaneous generative AI experiences.

Starting at 5:22 · Watch from the beginning

Performant Architecture for a Fast Gen AI User Experience thumbnail

Checking access…

Playback and chapters load privately for Free videos.

Matching moments

1:22 min

Leveraging the comprehensive generative artificial intelligence stack

Duan Lightfoot

Duan Lightfoot · World Congress 2024

1:10 min

Architecting a web real-time communication stack for agents

Nathaniel Okenwa

Nathaniel Okenwa · World Congress 2025

5:28 min

Integrating OpenAI for real-time streaming responses

Marius Obert

Marius Obert +3 · LIVE

4:03 min

Enhancing conversational output via generative AI models

Xavier Portilla Edo · LIVE

4:16 min

Addressing latency and architecture in voice agents

Marius Obert

Marius Obert +2 · LIVE

1:38 min

Scaling bottlenecks in generative AI applications

Stan Girard

Stan Girard · World Congress 2024

More from World Congress 2024

Beyond the Hype: Real-World AI Strategies Panel thumbnail

Beyond the Hype: Real-World AI Strategies Panel

Mike Butcher +3

Carl Lapierre - Exploring Advanced Patterns in Retrieval-Augmented Generation thumbnail

Carl Lapierre - Exploring Advanced Patterns in Retrieval-Augmented Generation

Carl Lapierre · Osedea

Coding an Immersive Copilot using Unity / .NET and Azure OpenAI! thumbnail

Coding an Immersive Copilot using Unity / .NET and Azure OpenAI!

Zaid Zaim · Neo4j

Building a diverse tech company: The power of Diversity, Equity, Inclusion, and Belonging thumbnail

Building a diverse tech company: The power of Diversity, Equity, Inclusion, and Belonging

Sue Quackenbush · Dynatrace

Livecoding with AI thumbnail

Livecoding with AI

Rainer Stropek · software architects

Dapr in Practice thumbnail

Dapr in Practice

marcklefter · AxonIQ

Upcoming sessions on this topic

Starts in 12 days

Conference India 2026

November 25–26, 2026

Bengaluru, India

Get tickets All 107 sessions

Build a Zero-Cost AI Agent in Your Browser
Aishwarya Mathuria & Nishant Thakur

Thu 26 Nov · Room 8
Bypassing the GPU Tax: Smart Layer-7 Routing with Small Language Models (SLMs)
Sagar Utekar · CrowdStrike

Thu 26 Nov · Stage 2
Built-In AI in the Browser: Practical Capabilities for Modern Web Apps
Piyush Gupta · Expedia

Thu 26 Nov · Stage 4

Related videos

Raise your voice! thumbnail

Raise your voice!

Lee Boonstra

LIVE · Jun 2020

Chatbots are going to destroy infrastructures and your cloud bills thumbnail

Chatbots are going to destroy infrastructures and your cloud bills

Stan Girard · Quivr

World Congress · 2024

Hello JARVIS - Building Voice Interfaces for Your LLMS thumbnail

Hello JARVIS - Building Voice Interfaces for Your LLMS

Nathaniel Okenwa · Twilio

World Congress · 2025

From Voice Demo to Enterprise Production thumbnail

From Voice Demo to Enterprise Production

Anahita Havewala +1

World Congress North America · 2026

Make it simple, using generative AI to accelerate learning thumbnail

Make it simple, using generative AI to accelerate learning

Duan Lightfoot · Akamai

World Congress · 2024

WeAreDevelopers LIVE - Local Transcriptions with Open-Source AI thumbnail

Local Transcriptions with Open-Source AI

Mattias Geniar +2

LIVE · Jun 2026

Related articles

CH

Chris Heilmann

WWC24 Talk - Scott Hanselman - AI: Superhero or Supervillain?

Join Scott Hanselman at WWC24 to explore AI's role as a superhero or supervillain. Scott shares his 32 years of experience in software engineering, discusses AI myths, ethical dilemmas, and tech ad...

about 2 years ago

WWC24 Talk - Scott Hanselman - AI: Superhero or Supervillain?

BB

Benedikt Bischof

MLOps And AI Driven Development

Welcome to this issue of the WeAreDevelopers Dev Talk Recap series. This article recaps an interesting talk by Natalie Pistunovic who spoke about the development of AI and MLOps. What you will lear...

over 4 years ago

MLOps And AI Driven Development

DC

Daniel Cranney

Stephan Gillich - Bringing AI Everywhere

In the ever-evolving world of technology, AI continues to be the frontier for innovation and transformation. Stephan Gillich, from the AI Center of Excellence at Intel, dove into the subject in a r...

about 2 years ago

Stephan Gillich - Bringing AI Everywhere

DC

Daniel Cranney

Infer Once, Run Everywhere: Zero-Token Architecture

“You are all having way too much fun burning way too many tokens”. Kelsey Hightower kicked off his talk at the WeAreDevelopers World Congress North America by calling out the developers in attend...

about 1 month ago

A close-up on a screen showing a terminal with 'today's token spend: 0' on it.

From learning to earning

Jobs that call for the skills explored in this talk.

about 2 months ago •

AI Software Engineer (Germany)

Berlin, Germany

Expert €70k–100k Remote REST TypeScript AI Frameworks

Engineer II, Google Cloud

Nashville, TN, United States

$61k–100k Databases Google Cloud Spring Cloud

Engineer II, Google Cloud

Portland, OR, United States

$61k–100k Databases Google Cloud Spring Cloud

Engineer II, Google Cloud

Los Angeles, CA, United States

$61k–100k Databases Google Cloud Spring Cloud

Engineer II, Google Cloud

Las Vegas, NV, United States

$61k–100k Databases Google Cloud Spring Cloud

Engineer II, Google Cloud

Phoenix, AZ, United States

$61k–100k Databases Google Cloud Spring Cloud