World Congress 2023 Oct 23, 2023

Building Real-Time AI/ML Agents with Distributed Data using Apache Cassandra and Astra DB

Dieter Flick

Standard LLMs fall short on real-time context. Stop overpaying for redundant model calls. Build lightning-fast AI agents using RAG, Astra DB, and semantic caching.

Pause
Mute Enter Fullscreen
#1 about 4 min

Introduction to building real-time generative agents

An overview of the session goals and DataStax's real-time data cloud offerings.

#2 about 3 min

Interacting with Astra DB using GraphQL APIs

Creating database schemas and ingesting records through the cloud platform API gateway.

#3 about 4 min

Enabling context with retrieval augmented generation

How retrieval-augmented generation supplies proprietary enterprise data to foundational language models.

#4 about 5 min

Architectural components of a generative AI agent

Coordinating language models, prompt engineering, and semantic databases enables reliable chatbot processing.

#5 about 6 min

Processing text for semantic vector search operations

Splitting content into manageable chunks allows the generation of embeddings for similarity matching.

#6 about 7 min

Constructing prompts and executing chatbot data queries

Combining user history, behavioral context, and semantic similarity produces rich queries for language models.

#7 about 3 min

Evaluating development tiers and answering audience questions

Exploring free database tiers and addressing inquiries about cloud regions and data privacy.

Matching moments

3:08 min

Scaling semantic search with Astra DB and Apache Cassandra

David Leconte David Leconte +1 · WWC 2024

1:24 min

Expanding AI capabilities using retrieval-augmented generation

Cedric Clyburn Cedric Clyburn · WWC 2024

1:32 min

Architectural patterns for developing robust generative AI applications

Julián Duque Julián Duque · WWC 2025

1:44 min

Understanding basic retrieval-augmented generation architectures in chatbots

Stan Girard Stan Girard · WWC 2024

2:27 min

Introducing conversational queries with AI data agents

Dr. Alexander Wachtel Dr. Alexander Wachtel +1 · WWC 2025

5:19 min

Providing context for retrieval augmented generation and agents

Ben Greenberg Ben Greenberg · WWC 2025

Upcoming sessions on this topic

Open session

World Congress 2026 North America

AI Agents are Only as Smart as their Context: Building a Real-Time Context Engine at Intuit

Bharat Patel

Lead Software Engineer at Intuit

Bharat Patel
Open session

World Congress 2026 North America

Building Stuff with GenAI - The Open Minded Workshop beyond OpenAI

Andreas Erben

CTO for Applied AI and Metaverse at daenet

Andreas Erben
Open session

World Congress 2026 North America

Databases in the Agent Era

Monica Sarbu

Founder and CEO of xata.io

Monica Sarbu
Open session

World Congress 2026 North America

DeepAgents: Build Multi-Agent AI Systems That Actually Work

Anagha Rumade, Anjana Umapathy, Apoorva Jaiswal

Anagha Rumade
Anjana Umapathy
Apoorva Jaiswal
Open session

World Congress 2026 North America

Beyond SQL Generation: How to Teach Agents What Your Database Actually Means

Kris Jenkins

Lead Developer Advocate at Snowflake

Kris Jenkins
Open session

World Congress 2026 North America

Agents That Own Their Inference: Building Production AI Agents on Dedicated GPUs

Duan Lightfoot

Sr. AI Engineer, Akamai

Duan Lightfoot