WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
World Congress 2024 • Aug 29, 2024 • Session details

Using LLMs in your Product

Daniel Töws

Integrating LLMs means shifting from rigid code to probabilistic workflows. Master structured prompt engineering, mitigate prompt injections, and leverage RAG to build secure, dynamic AI features.

Pause
Mute Enter Fullscreen
#1 about 2 min

Three pillars of integrating large language models into products

Developers can leverage modern generative AI frameworks through direct API integrations, prompt design, and function callbacks.

#2 about 7 min

Utilizing chat completion requests and managing context length

Sending full chat histories to stateless APIs requires understanding token limits and prioritizing models based on dataset size and recency.

#3 about 6 min

Applying prompt engineering best practices for reliable model outputs

Providing precise instructions with contextual personas and product references reduces ambiguity and minimizes factual hallucinations.

#4 about 5 min

Designing system messages and mitigating prompt injection security risks

Establishing rigid system messages helps prevent malicious user inputs from hijacking the intended conversation scope.

#5 about 5 min

Enhancing language models with backend logic using function calls

Exposing custom callback functions allows text generation models to retrieve real-time data or trigger external system actions.

#6 about 2 min

Exploring retrieval augmented generation and advanced prompting techniques

Implementing retrieval augmented generation provides a mechanism to query massive localized datasets without fine-tuning underlying models.

#7 about 7 min

Addressing context limits inference costs and reliable json generation

Managing persistent connection lifecycles involves summarizing historical data logs and validating structured outputs using explicit tool boundaries.

Matching moments

4:56 min

Building agentic workflows using prompt engineering and language models

2:45 min

Evolving traditional coding logic into LLM prompting

Ankit Patel Ankit Patel · World Congress 2024

1:12 min

Enhancing conversational intent through modern large language models

Nathaniel Okenwa Nathaniel Okenwa · World Congress 2025

2:44 min

Understanding language models and autonomous executing agents

Chris Heilmann +2 · LIVE

1:31 min

The shift from human prompt engineering to AI-generated prompts

Vitaly Friedman Vitaly Friedman · World Congress 2026 Europe

2:05 min

Enhancing language models with retrieval-augmented generation

Mary Grygleski Mary Grygleski · LIVE

More from World Congress 2024

Beyond the Hype: Real-World AI Strategies Panel thumbnail
24:07
12 months ago

Beyond the Hype: Real-World AI Strategies Panel

Mike Butcher, Jürgen Müller, Katrin Lehmann, Tobias Regenfuss

Carl Lapierre - Exploring Advanced Patterns in Retrieval-Augmented Generation thumbnail
21:17
almost 2 years ago

Carl Lapierre - Exploring Advanced Patterns in Retrieval-Augmented Generation

Carl Lapierre

Coding an Immersive Copilot using Unity / .NET and Azure OpenAI! thumbnail
31:50
about 2 years ago

Coding an Immersive Copilot using Unity / .NET and Azure OpenAI!

Zaid Zaim

Building a diverse tech company: The power of Diversity, Equity, Inclusion, and Belonging thumbnail
29:43
about 2 years ago

Building a diverse tech company: The power of Diversity, Equity, Inclusion, and Belonging

Sue Quackenbush

Dapr in Practice thumbnail
24:08
about 2 years ago

Dapr in Practice

marcklefter

Minimising the Carbon Footprint of Workloads thumbnail
27:46
about 2 years ago

Minimising the Carbon Footprint of Workloads

Michael Mueller

Upcoming sessions on this topic

Open session

World Congress 2026 North America

September 24, 2026 · 16:10–16:40

Stage 3

Sandboxing the Swarm: Building Secure, Serverless AI Agents with Wasm

Lena Hall, Thorsten Hans

Lena Hall
Thorsten Hans
Open session

World Congress 2026 North America

September 24, 2026 · 17:30–18:00

Stage 6

No Single Model to Rule Them All: Building Resilient AI Agents Across Open & Closed LLMs

Emmanuel Acheampong

Senior Manager Developer Relations at Crusoe AI

Emmanuel Acheampong
Open session

World Congress 2026 North America

September 24, 2026 · 13:30–14:00

Stage 9

Understanding LLM Architectures: Inside the Design of Modern Models

Jofia Jose Prakash

Director - AI & Governance at Humanity + AI, Inc

Jofia Jose Prakash
Open session

World Congress 2026 North America

September 24, 2026 · 14:25–14:35

Outdoor Stage

SecurePrompt: Building a Pre-Flight Security Layer for Agentic AI

Ravi Sastry Kadali

AI/ML Engineer at General Motors

Ravi Sastry Kadali
Open session

World Congress 2026 North America

September 25, 2026 · 14:10–14:40

Stage 4

Headroom: A Context Optimization Layer for LLM Applications

Tejas Chopra

Senior Software Engineer at Netflix

Tejas Chopra
Open session

World Congress 2026 North America

September 24, 2026 · 14:10–14:40

Stage 1

Anatomy of an AI Request: Where Latency and Cost Are Really Born

Dan Fu

VP of Kernels at Together AI

Dan Fu

Related videos

Creating Industry ready solutions with LLM Models thumbnail
58:00
LIVE • over 2 years ago

Creating Industry ready solutions with LLM Models

Vijay Krishan Gupta, Gauravdeep Singh Lotey

Bringing the power of AI to your application. thumbnail
32:26
World Congress 2024 • about 2 years ago

Bringing the power of AI to your application.

Krzysztof Cieślak

Three years of putting LLMs into Software - Lessons learned thumbnail
26:30
World Congress 2025 • about 1 year ago

Three years of putting LLMs into Software - Lessons learned

Simon A.T. Jiménez

You are not my model anymore - understanding LLM model behavior thumbnail
24:11
World Congress 2025 • about 1 year ago

You are not my model anymore - understanding LLM model behavior

Andreas Erben

ChatGPT, ignore the above instructions! Prompt injection attacks and how to avoid them. thumbnail
27:32
World Congress 2023 • almost 3 years ago

ChatGPT, ignore the above instructions! Prompt injection attacks and how to avoid them.

Sebastian Schrittwieser

Prompt Injection, Poisoning & More: The Dark Side of LLMs thumbnail
23:24
World Congress 2025 • about 1 year ago

Prompt Injection, Poisoning & More: The Dark Side of LLMs

Keno Dreßel

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.