World Congress 2024 • Aug 20, 2024 • Session details

Infusing Generative AI in your Java Apps with LangChain4j

Kevin Dubois

What if adding generative AI to your Java apps was as simple as using an annotation? Learn how LangChain4j turns complex prompt engineering into straightforward, resilient code.

Pause
Mute Enter Fullscreen
#1 about 2 min

Consuming generative artificial intelligence models in Java

Traditional developers can interact with AI models through standard serving APIs using familiar application frameworks.

#2 about 5 min

Bootstrapping Java applications using the LangChain4j library

Setting up a new Quarkus project mapped to OpenAI requires a simple dependency configuration.

#3 about 3 min

Injecting context and formatting output via AI prompts

Interfaces leverage specific annotations like system messages to dictate context and map responses directly to Java objects.

#4 about 3 min

Maintaining conversational state with memory providers

Chat memory mechanisms preserve previous interactions and scope parallel conversations using isolated identifier tags.

#5 about 2 min

Bridging large language models and deterministic business code

Natural language instructions trigger precise application functions using specific tool annotations within standard class methods.

#6 about 5 min

Testing generative content and automated email triggering

The application creates AI-generated poetry through web endpoints and pipes the text output to localized mail servers.

#7 about 3 min

Augmenting model knowledge using document embedding stores

Storing serialized internal business documents in vector databases equips base models to answer highly specialized organizational queries.

#8 about 1 min

Simplified vector indexing via Quarkus Easy RAG

The Easy RAG extension accelerates context building by directly ingesting local resource directories into memory at startup.

#9 about 7 min

Building custom domain chatbots evaluated by local documents

An interactive service agent parses vectorized policy documents to correctly approve or enforce system-defined booking restrictions.

#10 about 2 min

Providing robustness with local models and network fallbacks

Adding microprofile implementations alongside localized container runtimes guarantees service availability during external connectivity disruptions.

#11 about 4 min

Invoking localized container models with configured retries

Shutting off the primary endpoint forces the application engine to traverse the retry circuit before deploying fallback methods.

Matching moments

2:56 min

Integrating local AI models into Java Quarkus applications

Cedric Clyburn Cedric Clyburn · WWC 2024

2:31 min

Accelerating AI delivery with Quarkus and LangChain4j

Daniel Oh Daniel Oh · WWC Europe 2026

2:55 min

Building AI interactions in Java with LangChain4j

Alex Soto Alex Soto · WWC 2025

3:36 min

Overview of generative AI and the presentation agenda

juarezjunior juarezjunior · WWC 2024

2:54 min

Utilizing Java frameworks to interface with AI models

Mary Grygleski Mary Grygleski · LIVE

4:46 min

Implementing generative AI features using LangChain4j

Timo Salm Timo Salm · WWC 2025

Upcoming sessions on this topic

Open session

World Congress 2026 North America

Look What Java Can Do Now: Live-Coding a GenAI MCP Server with the JAQ Stack

Suren Konathala

Senior Engineering Leader, Marketing & AdTech, AI GTM & Digital Experience Platforms, Java x AI

Suren Konathala
Open session

World Congress 2026 North America

Building Stuff with GenAI - The Open Minded Workshop beyond OpenAI

Andreas Erben

CTO for Applied AI and Metaverse at daenet

Andreas Erben
Open session

World Congress 2026 North America

DeepAgents: Build Multi-Agent AI Systems That Actually Work

Anagha Rumade, Anjana Umapathy, Apoorva Jaiswal

Anagha Rumade
Anjana Umapathy
Apoorva Jaiswal
Open session

World Congress 2026 North America

AI Agents are Only as Smart as their Context: Building a Real-Time Context Engine at Intuit

Bharat Patel

Lead Software Engineer at Intuit

Bharat Patel
Open session

World Congress 2026 North America

Who Tests the AI? Building Trustworthy AI Systems at Enterprise Scale

Him Raj Singh

PayPal, Manager, Software Engineer

Him Raj Singh
Open session

World Congress 2026 North America

No Single Model to Rule Them All: Building Resilient AI Agents Across Open & Closed LLMs

Emmanuel Acheampong

Senior Manager Developer Relations at Crusoe AI

Emmanuel Acheampong