World Congress 2023 Oct 23, 2023

Building Real-Time AI/ML Agents with Distributed Data using Apache Cassandra and Astra DB

Dieter Flick

Standard LLMs fall short on real-time context. Stop overpaying for redundant model calls. Build lightning-fast AI agents using RAG, Astra DB, and semantic caching.

Pause
Mute Enter Fullscreen
#1 about 4 min

Introduction to building real-time generative agents

An overview of the session goals and DataStax's real-time data cloud offerings.

#2 about 3 min

Interacting with Astra DB using GraphQL APIs

Creating database schemas and ingesting records through the cloud platform API gateway.

#3 about 4 min

Enabling context with retrieval augmented generation

How retrieval-augmented generation supplies proprietary enterprise data to foundational language models.

#4 about 5 min

Architectural components of a generative AI agent

Coordinating language models, prompt engineering, and semantic databases enables reliable chatbot processing.

#5 about 6 min

Processing text for semantic vector search operations

Splitting content into manageable chunks allows the generation of embeddings for similarity matching.

#6 about 7 min

Constructing prompts and executing chatbot data queries

Combining user history, behavioral context, and semantic similarity produces rich queries for language models.

#7 about 3 min

Evaluating development tiers and answering audience questions

Exploring free database tiers and addressing inquiries about cloud regions and data privacy.

Matching moments

3:08 min

Scaling semantic search with Astra DB and Apache Cassandra

David Leconte David Leconte +1 · World Congress 2024

1:24 min

Expanding AI capabilities using retrieval-augmented generation

Cedric Clyburn Cedric Clyburn · World Congress 2024

1:32 min

Architectural patterns for developing robust generative AI applications

Julián Duque Julián Duque · World Congress 2025

1:44 min

Understanding basic retrieval-augmented generation architectures in chatbots

Stan Girard Stan Girard · World Congress 2024

2:27 min

Introducing conversational queries with AI data agents

Dr. Alexander Wachtel Dr. Alexander Wachtel +1 · World Congress 2025

5:19 min

Providing context for retrieval augmented generation and agents

Ben Greenberg Ben Greenberg · World Congress 2025

Upcoming sessions on this topic

Open session

World Congress 2026 North America

September 25, 2026 · 09:00–09:30

Stage 7

AI Agents are Only as Smart as their Context: Building a Real-Time Context Engine at Intuit

Bharat Patel

Lead Software Engineer at Intuit

Bharat Patel
Open session

World Congress 2026 North America

September 24, 2026 · 16:10–16:40

Stage 1

Sandboxing the Swarm: Building Secure, Serverless AI Agents with Wasm

Lena Hall, Thorsten Hans

Lena Hall
Thorsten Hans
Open session

World Congress 2026 North America

September 23, 2026 · 10:00–17:00

Stage 11

Building Stuff with GenAI - The Open Minded Workshop beyond OpenAI

Andreas Erben

CTO for Applied AI and Metaverse at daenet

Andreas Erben
Open session

World Congress 2026 North America

September 24, 2026 · 14:50–15:20

Stage 2

Databases in the Agent Era

Monica Sarbu

Founder and CEO of xata.io

Monica Sarbu
Open session

World Congress 2026 North America

September 23, 2026 · 13:15–15:15

Stage 9

DeepAgents: Build Multi-Agent AI Systems That Actually Work

Anagha Rumade, Anjana Umapathy, Apoorva Jaiswal

Anagha Rumade
Anjana Umapathy
Apoorva Jaiswal
Open session

World Congress 2026 North America

September 25, 2026 · 16:10–16:40

Stage 6

Beyond SQL Generation: How to Teach Agents What Your Database Actually Means

Kris Jenkins

Host / Developer Voices

Kris Jenkins