World Congress 2024 • Aug 20, 2024 • Session details

Build RAG from Scratch

philnash

Phil Nash proves you can build a vector search engine from scratch using just Node.js. Ditch traditional keyword matching and master the math behind Retrieval-Augmented Generation.

Pause
Mute Enter Fullscreen
#1 about 2 min

Overcoming large language model knowledge gaps

Large language models lack access to private organizational data and suffer from strict knowledge cutoff dates.

#2 about 2 min

Understanding the architecture of retrieval augmented generation

Augmenting user prompts with natively retrieved data context gives models accurate information to generate informed responses.

#3 about 2 min

Searching by semantic meaning with vector embeddings

Converting text into structured lists of numbers allows systems to mathematically represent and search for semantic meaning.

#4 about 7 min

Creating a sparse bag-of-words vector from plain text

Extracting a unique glossary enables generating a sparse array representation of text frequency using basic scripts.

#5 about 6 min

Measuring dimensional vector angle with cosine similarity

Calculating multidimensional vector direction through dot product and magnitude equations determines the structural similarity of records.

#6 about 2 min

Returning relevant matches with local similarity sorting

Mapping cosine similarity scores against incoming search vectors provides a functional foundation for local context retrieval.

#7 about 2 min

Understanding the performance and semantic limits of bag-of-words

A raw vocabulary approach suffers from exact-word dependency, calculation overhead, and ignores inherent linguistic context.

#8 about 2 min

Switching from sparse representations to dense embedding models

Purpose-built LLM embedding protocols automatically compress complex phrasing and negative inference into densely packed numerical dimensions.

#9 about 4 min

Scaling vector similarity search using dedicated databases

Vector databases handle high-volume embedding storage and native nearest-neighbor indexing far more efficiently than iterated local arrays.

#10 about 2 min

Advancing semantic boundaries with colbert and knowledge graphs

Incorporating token-level evaluation logic, knowledge graphs, and dedicated related-content engines significantly deepens modern system retrieval capabilities.

Matching moments

1:44 min

Understanding basic retrieval-augmented generation architectures in chatbots

Stan Girard Stan Girard · World Congress 2024

3:50 min

Building local RAG architectures using the Anything LLM tool

Cedric Clyburn Cedric Clyburn +1 · World Congress 2025

1:57 min

Understanding overarching retrieval and generation steps in RAG architectures

Csenge Szabo Csenge Szabo · Europe 2026 Virtual

1:24 min

Expanding AI capabilities using retrieval-augmented generation

Cedric Clyburn Cedric Clyburn · World Congress 2024

1:28 min

Reviewing the basic retrieval-augmented generation pipeline

Carl Lapierre Carl Lapierre · World Congress 2024

2:05 min

Enhancing language models with retrieval-augmented generation

Mary Grygleski Mary Grygleski · LIVE