World Congress 2025 • Aug 20, 2025 • Session details

Hello JARVIS - Building Voice Interfaces for Your LLMS

Nathaniel Okenwa

Why do most AI voice bots feel awkwardly robotic? Learn to build intuitive, JARVIS-like voice interfaces by engineering responsive state routing, fluid interruptions, and composable LLM pipelines.

Pause
Mute Enter Fullscreen
#1 about 2 min

Introduction to real-time communication programming interfaces

How modern application programming infrastructures facilitate voiceover real-time messaging pipelines.

#2 about 4 min

Designing voice interfaces inspired by fictional artificial intelligence

Why science fiction uses ambient computing and vocal communication as intuitive shortcuts for human-computer interaction.

#3 about 2 min

Enhancing conversational intent through modern large language models

How unscripted interactions and action-oriented tool paths resolve the contextual brittleness of early virtual assistants.

#4 about 5 min

Navigating the conversational uncanny valley in voice systems

Managing psychological reactions to machine pacing and non-verbal gaps to ensure flowing interaction workflows.

#5 about 2 min

Architecting a web real-time communication stack for agents

Routing live audio streams through decoupled transcription and generative endpoints to facilitate smooth conversations.

#6 about 3 min

Evaluating decoupled conversational architectures versus end-to-end models

Why modular sequence pipelines offer better logic injection and behavioral fine-tuning than monolithic processing environments.

#7 about 8 min

Programming contextual interruption logic for responsive machine interaction

Tracking active playback states to dynamically pause out-of-date audio outputs and append localized interruption history.

#8 about 5 min

Implementing voice interstitials to mask background computational latency

Evaluating background network tasks to emit temporary auditory dialog while complex external data sources resolve.

#9 about 3 min

Orchestrating managed communication platforms for enterprise production readiness

Offloading intensive timing states and concurrent socket delivery back to centralized conversational cloud relay services.

Matching moments

2:05 min

Challenges of managing voice architecture and latency

Chris Heilmann Chris Heilmann +3 · LIVE

2:11 min

Analyzing voice interface research projects and technical limitations

Tobias Münch Tobias Münch · World Congress 2024

6:00 min

Expectations versus reality for voice and virtual interfaces

Léonie Watson · A11y + AI

4:16 min

Addressing latency and architecture in voice agents

Chris Heilmann Chris Heilmann +2 · LIVE

49 sec

Understanding the complexities of building voice AI agents

Matt Wyman Matt Wyman · World Congress 2026 North America

42 sec

Delivering dynamic voice interactions via ElevenLabs

Alexandra Mihai Alexandra Mihai +2 · Europe 2026 Virtual

Upcoming sessions on this topic

Open session

ULTRON: Your Agent Has No Hands - Real-Time Voice, MCP, and Ten Phones on Stage

  • Sagar Tamang

    Two Spoon Technologies

    AI Engineer

Open session

Build a Zero-Cost AI Agent in Your Browser

  • Aishwarya Mathuria

    Adobe

    Computer Scientist

  • Nishant Thakur

    Adobe

    Senior Computer Scientist

Open session

Teaching AI Coding Agents to Build It Right the First Time

  • Sajeetharan Sinnathurai

    Microsoft

    Principal Product Manager

Open session

React Under Fire: Rendering Performance for Streaming Agent UIs

  • Abhirupa Mitra

    Slack

    Senior Member of Technical Staff

Open session

Architecting Trusted AI: Coupling Multi-Agent Systems with dbt Semantic Store for Zero-Hallucination

  • Pushkar Mishra

    J.P. Morgan

    Senior Vice President

Open session

Java is Coming for Python’s Lunch: The Rise of JVM AI Agents

  • Frederik Pietzko

    Jetbrains

    Developer Advocate