WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
World Congress 2024 • Aug 29, 2024 • Session details

Using LLMs in your Product

Daniel Töws

Integrating LLMs means shifting from rigid code to probabilistic workflows. Master structured prompt engineering, mitigate prompt injections, and leverage RAG to build secure, dynamic AI features.

Pause
Mute Enter Fullscreen
#1 about 2 min

Three pillars of integrating large language models into products

Developers can leverage modern generative AI frameworks through direct API integrations, prompt design, and function callbacks.

#2 about 7 min

Utilizing chat completion requests and managing context length

Sending full chat histories to stateless APIs requires understanding token limits and prioritizing models based on dataset size and recency.

#3 about 6 min

Applying prompt engineering best practices for reliable model outputs

Providing precise instructions with contextual personas and product references reduces ambiguity and minimizes factual hallucinations.

#4 about 5 min

Designing system messages and mitigating prompt injection security risks

Establishing rigid system messages helps prevent malicious user inputs from hijacking the intended conversation scope.

#5 about 5 min

Enhancing language models with backend logic using function calls

Exposing custom callback functions allows text generation models to retrieve real-time data or trigger external system actions.

#6 about 2 min

Exploring retrieval augmented generation and advanced prompting techniques

Implementing retrieval augmented generation provides a mechanism to query massive localized datasets without fine-tuning underlying models.

#7 about 7 min

Addressing context limits inference costs and reliable json generation

Managing persistent connection lifecycles involves summarizing historical data logs and validating structured outputs using explicit tool boundaries.

Matching moments

4:56 min

Building agentic workflows using prompt engineering and language models

2:45 min

Evolving traditional coding logic into LLM prompting

Ankit Patel Ankit Patel · World Congress 2024

1:12 min

Enhancing conversational intent through modern large language models

Nathaniel Okenwa Nathaniel Okenwa · World Congress 2025

2:44 min

Understanding language models and autonomous executing agents

Chris Heilmann Chris Heilmann +2 · LIVE

1:31 min

The shift from human prompt engineering to AI-generated prompts

Vitaly Friedman Vitaly Friedman · World Congress 2026 Europe

2:05 min

Enhancing language models with retrieval-augmented generation

Mary Grygleski Mary Grygleski · LIVE

More from World Congress 2024

Beyond the Hype: Real-World AI Strategies Panel thumbnail
24:07
12 months ago

Beyond the Hype: Real-World AI Strategies Panel

Mike Butcher, Jürgen Müller, Katrin Lehmann, Tobias Regenfuss

Carl Lapierre - Exploring Advanced Patterns in Retrieval-Augmented Generation thumbnail
21:17
almost 2 years ago

Carl Lapierre - Exploring Advanced Patterns in Retrieval-Augmented Generation

Carl Lapierre

Coding an Immersive Copilot using Unity / .NET and Azure OpenAI! thumbnail
31:50
about 2 years ago

Coding an Immersive Copilot using Unity / .NET and Azure OpenAI!

Zaid Zaim

Building a diverse tech company: The power of Diversity, Equity, Inclusion, and Belonging thumbnail
29:43
about 2 years ago

Building a diverse tech company: The power of Diversity, Equity, Inclusion, and Belonging

Sue Quackenbush

Dapr in Practice thumbnail
24:08
about 2 years ago

Dapr in Practice

marcklefter

Minimising the Carbon Footprint of Workloads thumbnail
27:46
about 2 years ago

Minimising the Carbon Footprint of Workloads

Michael Mueller

Related videos

Creating Industry ready solutions with LLM Models thumbnail
58:00
LIVE • over 2 years ago

Creating Industry ready solutions with LLM Models

Vijay Krishan Gupta, Gauravdeep Singh Lotey

Bringing the power of AI to your application. thumbnail
32:26
World Congress 2024 • about 2 years ago

Bringing the power of AI to your application.

Krzysztof Cieślak

Three years of putting LLMs into Software - Lessons learned thumbnail
26:30
World Congress 2025 • about 1 year ago

Three years of putting LLMs into Software - Lessons learned

Simon A.T. Jiménez

You are not my model anymore - understanding LLM model behavior thumbnail
24:11
World Congress 2025 • about 1 year ago

You are not my model anymore - understanding LLM model behavior

Andreas Erben

ChatGPT, ignore the above instructions! Prompt injection attacks and how to avoid them. thumbnail
27:32
World Congress 2023 • almost 3 years ago

ChatGPT, ignore the above instructions! Prompt injection attacks and how to avoid them.

Sebastian Schrittwieser

Prompt Injection, Poisoning & More: The Dark Side of LLMs thumbnail
23:24
World Congress 2025 • about 1 year ago

Prompt Injection, Poisoning & More: The Dark Side of LLMs

Keno Dreßel

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.