Simon A.T. Jiménez
Three years of putting LLMs into Software - Lessons learned
#1about 4 minutes
Understanding the fundamental nature of LLMs
LLMs are unreliable pattern matchers that appear intelligent but lack true understanding, requiring developers to manage context and anticipate failures.
#2about 4 minutes
Controlling LLM output with API parameters
API parameters like temperature and top_p allow for control over the determinism and creativity of LLM responses by manipulating token selection probabilities.
#3about 7 minutes
Viewing LLMs as a new kind of API
LLMs should be treated as a new type of API for text manipulation, not as intelligent agents, because they are advanced pattern matchers with significant limitations.
#4about 5 minutes
Implementing practical LLM use cases in software
LLMs can be used for tasks like audio transcription, image analysis for OCR, and text reformulation by providing clear instructions and examples in the prompt.
#5about 4 minutes
Navigating legal compliance and data privacy
Using paid APIs with data privacy contracts, implementing human-in-the-loop workflows, and understanding the European AI Act are crucial for legal compliance.
#6about 2 minutes
Understanding the security risks of AI integrations
Integrating LLMs with external APIs or internal data creates significant security risks like prompt injection, requiring careful control over the AI's permissions and actions.
Related jobs
Jobs that call for the skills explored in this talk.
Featured Partners
Related Videos
Using LLMs in your Product
Daniel Töws
Inside the Mind of an LLM
Emanuele Fabbiani
Bringing the power of AI to your application.
Krzysztof Cieślak
Hello JARVIS - Building Voice Interfaces for Your LLMS
Nathaniel Okenwa
You are not my model anymore - understanding LLM model behavior
Andreas Erben
AI: Superhero or Supervillain? How and Why with Scott Hanselman
Scott Hanselman
Self-Hosted LLMs: From Zero to Inference
Roberto Carratalá, Cedric Clyburn
Exploring LLMs across clouds
Tomislav Tipurić
From learning to earning
Jobs that call for the skills explored in this talk.


Senior Backend Engineer – AI Integration (m/w/x)
chatlyn GmbH
Vienna, Austria
Senior
JavaScript
AI-assisted coding tools
Agentic AI Architect - Python, LLMs & NLP
FRG Technology Consulting
Intermediate
Azure
Python
Machine Learning
Machine Learning Engineer
Speechmatics
Charing Cross, United Kingdom
Remote
€39K
Machine Learning
Speech Recognition
AI/ML Team Lead - Generative AI (LLMs, AWS)
Provectus
Canton de Saint-Mihiel, France
Remote
€96K
Senior
Python
PyTorch
TensorFlow
+4
AIML - Machine Learning Research (Speech), DMLI
Apple Firmenprofil
Aachen, Germany
Confluence
Machine Learning
AI Evaluation Data Scientist - AI/ML/LLM - (Hybrid (Hybrid) - Barcelona
European Tech Recruit
Barcelona, Spain
Intermediate
GIT
Python
Pandas
Docker
PyTorch
+2
AI/ML Team Lead - Generative AI (LLMs, AWS)
Provectus
Canton de Saint-Mihiel, France
Remote
€96K
Senior
Python
PyTorch
TensorFlow
+4
Senior AI Integration Engineer (LLM/Conversational UX) (all genders)
clockin GmbH
Münster, Germany
Senior
API
Azure
Python
TypeScript
Amazon Web Services (AWS)





