Alex Soto, Markus Eisele
RAG like a hero with Docling
#1about 3 minutes
Using RAG to enrich LLMs with proprietary data
Retrieval-augmented generation (RAG) is the key to making large language models useful for enterprises by providing them with up-to-date, proprietary information.
#2about 4 minutes
The challenge of parsing complex document structures
Simple document parsers can misinterpret layouts like multi-column text, leading to corrupted data and incorrect outputs from the language model.
#3about 3 minutes
Using Docling to convert documents into structured formats
Docling is an open-source tool that acts like an advanced OCR service, converting various binary document formats into a structured, parsable tree.
#4about 7 minutes
Demo of a basic RAG ingestion pipeline
A live demonstration shows how a Quarkus application uses Docling to ingest a PDF, generate embeddings, and store the resulting chunks and vectors in Redis.
#5about 3 minutes
Securing RAG against data poisoning and leaks
To prevent data poisoning and sensitive data leaks, it is crucial to sanitize documents, verify their signatures, and use tools for PII masking.
#6about 4 minutes
Mitigating vector store attacks and encryption challenges
Vector stores are vulnerable to attacks like close vector modification and reversal, and standard encryption breaks vector distance, requiring specialized solutions.
#7about 5 minutes
Demo of a secure ingestion pipeline in action
A final demonstration showcases a secure pipeline that verifies document signatures, anonymizes sensitive data, and encrypts vectors before storing them.
Related jobs
Jobs that call for the skills explored in this talk.
Featured Partners
Related Videos
Carl Lapierre - Exploring Advanced Patterns in Retrieval-Augmented Generation
Carl Lapierre
Building Blocks of RAG: From Understanding to Implementation
Ashish Sharma
Accelerating GenAI Development: Harnessing Astra DB Vector Store and Langflow for LLM-Powered Apps
Dieter Flick, Michel de Ru
Build RAG from Scratch
Phil Nash
Large Language Models ❤️ Knowledge Graphs
Michael Hunger
Beyond the Hype: Building Trustworthy and Reliable LLM Applications with Guardrails
Alex Soto
Building AI Applications with LangChain and Node.js
Julián Duque
Langchain4J - An Introduction for Impatient Developers
Juarez Junior
From learning to earning
Jobs that call for the skills explored in this talk.


Domain Architect Ricardo Platform (f/m/d) | 80-100% | Hybrid working model | Valbonne France
SMG Swiss Marketplace Group
Canton de Valbonne, France
Senior
Security-by-Design for Trustworthy Machine Learning Pipelines
Association Bernard Gregory
Machine Learning
Continuous Delivery
Agentic AI Architect - Python, LLMs & NLP
FRG Technology Consulting
Intermediate
Azure
Python
Machine Learning
Data Engineer - Machine Learning | Fraud & Abuse
DeepL
Charing Cross, United Kingdom
Remote
€40K
.NET
Python
Machine Learning
Software Engineer - KI & Retrieval (RAG/Azure) (m/w/d)
Jurafuchs
Berlin, Germany
Remote
API
Azure
Python
Node.js
+4
LLM-AI Engineer | Python | Arquitecturas RAG (100% remoto)
Diverger
Municipality of Madrid, Spain
Azure
Python
Amazon Web Services (AWS)
Senior Full Stack Software Developer für KI-Assets und RAG-Produkte (Retrieval-Augmented Generation)
Iq Plus
Zürich, Switzerland
Senior
Azure
React
Python
Docker
Node.js
+1





