WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
World Congress 2022 • Jun 15, 2022

Writing a full-text search engine in TypeScript

Michele Riva

Slow programming languages are a myth. Bad data structures are the reality. Watch how mastering algorithms unlocks microsecond full-text search speeds natively in TypeScript.

Pause
Mute Enter Fullscreen
#1 about 4 min

The motivation for building a search engine from scratch

Rebuilding established text tools helps develop a deeper understanding of underlying algorithms and data structures.

#2 about 1 min

Understanding the core concept of full-text search

Full-text search quickly finds content variations across database tables using text indexes without scanning entire rows.

#3 about 2 min

Reviewing existing open source full-text search tools

Popular database solutions like Elasticsearch and modern alternatives in Rust offer robust feature sets for production search configurations.

#4 about 2 min

Tokenizing strings to extract meaningful individual words

Tokenization strips special characters and removes exact duplicates to standardize text elements for easier querying.

#5 about 1 min

Removing commonly used stop words from indexed text

Eliminating frequent but low-information words reduces database size and speeds up relevant term lookups.

#6 about 3 min

Reducing terms to their roots using word stemming

Stemming resolves pluralization and conjugations into a shared common text base to capture broader intent regardless of exact grammar.

#7 about 5 min

Optimizing term retrieval using hash map structures

Storing string values through a hashing algorithm provides rapid constant-time complexity for designated index lookups.

#8 about 2 min

Accelerating term discovery via inverted memory indexes

Inverted text indexes map raw words back to document identifiers rather than scanning individual files sequentially.

#9 about 4 min

Compressing duplicate prefixes with tree data structures

Prefix trees or tries minimize wasted memory limits by grouping identical word beginnings into shared connected paths.

#10 about 3 min

Implementing prefix tree nodes natively in TypeScript

Applying typed maps and robust object structures guarantees proper element tracking during native programmatic tree node creation.

#11 about 3 min

Traversing tree paths without tail call optimization

Constructing tree search methods requires deliberate traversal logic given that JavaScript engines typically lack active tail call optimization.

#12 about 2 min

Tolerating input spelling mistakes using dynamic programming

Breaking distance calculations down into separate sub-problems mathematically adapts complex search queries for unrecognized typos or phrasing.

#13 about 7 min

Computing character variations with Levenshtein distance matrices

The Levenshtein algorithm systematically determines optimal insertion, deletion, and replacement operations to measure exact text transformations.

#14 about 2 min

Evaluating Levenshtein edit distance within prefix trees

Comparing edit distance algorithms directly across trie memory branches enables seamless typo resolution against comprehensively populated dictionaries.

#15 about 3 min

Benchmarking querying speed limits using the Lira engine

The designated open-source search runtime validates raw speed advantages achieved by pairing proper typing with highly specialized operational structures.

#16 about 4 min

Handling natural language processing rules and memory constraints

Analyzing edge cases confirms distinct approaches for acronym retention and mitigation of intense memory footprint limitations.

Matching moments

3:28 min

Implementing natural language processing algorithms in Node.js

Thomas Reiter · LIVE

49 sec

Summary of effective generative engine optimization tactics

Klaus-M. Schremser Klaus-M. Schremser · World Congress 2026 Europe

3:18 min

Demonstrating the completed multi-step search engine

Dmytro Kurets Dmytro Kurets · Europe 2026 Virtual

1:23 min

Powering website search queries with generative language algorithms

Kapil Gupta Kapil Gupta · World Congress 2023

2:05 min

Designing highly scalable hybrid AI search engines

Jan Schweiger · World Congress 2022

1:43 min

Speaker background and initial programmatic SEO motivations

Dino Lozina · World Congress 2022

More from World Congress 2022

What the heck do "declarative" and "reactive" actually mean? thumbnail
30:40
about 4 years ago

What the heck do "declarative" and "reactive" actually mean?

André Kovac

The Design and Evolution of C++ thumbnail
1:01:15
over 4 years ago

The Design and Evolution of C++

Bjarne Stroustrup

But, you're not Facebook thumbnail
31:12
over 4 years ago

But, you're not Facebook

Kristijan Ristovski

Communicate efficiently with Software Architecture Diagrams thumbnail
28:11
over 4 years ago

Communicate efficiently with Software Architecture Diagrams

Simon Lasselsberger

Get Ready for Jakarta EE 10! thumbnail
42:53
over 4 years ago

Get Ready for Jakarta EE 10!

Ivar Grimstad

Keep your code refactorable thumbnail
26:46
over 4 years ago

Keep your code refactorable

Gerrit Stapper

Related videos

Harry Potter and the Elastic Semantic Search thumbnail
57:52
LIVE • over 2 years ago

Harry Potter and the Elastic Semantic Search

Iulia Feroli

Tomb rAIder: AI Search with Kotlin thumbnail
36:59
Europe 2026 Virtual • 3 months ago

Tomb rAIder: AI Search with Kotlin

Dmytro Kurets

Hybrid AI: Next Generation Natural Language Processing thumbnail
21:01
World Congress 2022 • over 4 years ago

Hybrid AI: Next Generation Natural Language Processing

Jan Schweiger

WeAreDevelopers LIVE - Vector Similarity Search Patterns for Efficiency and more thumbnail
1:05:44
LIVE • about 1 year ago

WeAreDevelopers LIVE - Vector Similarity Search Patterns for Efficiency and more

Chris Heilmann, Daniel Cranney, Raphael De Lio, Advocate At Redis

ChatGPT vs Google: SEO in the Age of AI Search - Eric Enge thumbnail
36:44
Coffee With Developers • over 1 year ago

ChatGPT vs Google: SEO in the Age of AI Search - Eric Enge

Eric Enge

Search and aggregations made easy with OpenSearch and NodeJS thumbnail
28:55
World Congress 2022 • over 4 years ago

Search and aggregations made easy with OpenSearch and NodeJS

Olena Kutsenko

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.