WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
World Congress 2022 • Jun 15, 2022

Search and aggregations made easy with OpenSearch and NodeJS

Olena Kutsenko

How do you build a highly scalable search engine? Discover how to integrate OpenSearch with Node.js to index, query, and visualize massive datasets effortlessly.

Pause
Mute Enter Fullscreen
#1 about 2 min

Introduction to OpenSearch and data management

The necessity of fast data stores and the transition from Elasticsearch to OpenSearch.

#2 about 3 min

Core OpenSearch cluster architecture and terminology

How mapping, indexing, shards, nodes, and clusters distribute search workloads horizontally.

#3 about 1 min

Setting up the Nodejs project and repository

Cloning the demonstration repository and preparing the local JavaScript environment.

#4 about 2 min

Provisioning a cluster with managed OpenSearch

Using open-source binaries or managed services to launch the backing search cluster.

#5 about 2 min

Introducing the sample Kaggle recipe dataset

Downloading a database of recipes for exploring search and aggregation endpoints.

#6 about 2 min

Configuring the Nodejs OpenSearch client connection

Connecting to the cluster securely using environment variables and client configuration scripts.

#7 about 3 min

Ingesting dataset files via the bulk endpoint

Pushing thousands of JSON objects iteratively into the cluster index using bulk commands.

#8 about 2 min

Retrieving automatically generated cluster index schemas

Fetching mapping metadata to observe inferred property types like dates and floats.

#9 about 1 min

Sending a fundamental match search query

Executing simple text searches against target index fields to receive relevant matching items.

#10 about 2 min

Breaking down the domain specific language request

Understanding the anatomy of the JSON payload powering complex queries and relevance scoring.

#11 about 2 min

Controlling word distance with match phrase

Adjusting query strictness and spacing flexibility using the phrase slop parameter.

#12 about 1 min

Sifting targeted values using term queries

Applying exact matching on specific numerical ranges or un-scored field values within properties.

#13 about 2 min

Combining logic with query string and boolean queries

Writing readable inclusion and exclusion rules to heavily restrict search result variations.

#14 about 2 min

Generating dataset statistics with averaging aggregations

Calling aggregation endpoints rather than queries to compute aggregate metrics across items.

#15 about 2 min

Sorting items sequentially into histogram buckets

Chunking recipes chronologically based on associated continuous properties to observe historical groupings.

#16 about 3 min

Visualizing aggregated dimensions within OpenSearch dashboards

Configuring external cluster dashboards to explicitly draw rating bar charts and tag clouds.

#17 about 3 min

Examining manual telemetry limits via discover tools

Using the explorer panels and built-in interactive requests without writing underlying Javascript functions.

#18 about 3 min

Dealing with mixed payloads and structural patterns

Audience questions addressing varied JSON mapping strategies, open-source licensing splits, and heavy collection handling.

Matching moments

3:00 min

Benchmarking SearchOLAP against existing database engines

Andrey Abramov Andrey Abramov · WWC Europe 2026

1:49 min

Reviewing the legacy search architecture using OpenSearch

Dharin Shah Dharin Shah · WWC 2025

4:51 min

Executing simple full-text search queries using the Kibana interface

Derek Binkley · LIVE

1:52 min

Introducing SearchOLAP for native analytical processing

Andrey Abramov Andrey Abramov · WWC Europe 2026

1:41 min

Open source technology stack for workflow orchestration

Phil Nash · Coffee With Developers

5:00 min

Q&A on analytical databases and market convergence

Andrey Abramov Andrey Abramov · WWC Europe 2026

More from World Congress 2022

What the heck do "declarative" and "reactive" actually mean? thumbnail
30:40
almost 4 years ago

What the heck do "declarative" and "reactive" actually mean?

André Kovac

The Design and Evolution of C++ thumbnail
1:01:15
about 4 years ago

The Design and Evolution of C++

Bjarne Stroustrup

But, you're not Facebook thumbnail
31:12
about 4 years ago

But, you're not Facebook

Kristijan Ristovski

Communicate efficiently with Software Architecture Diagrams thumbnail
28:11
about 4 years ago

Communicate efficiently with Software Architecture Diagrams

Simon Lasselsberger

Get Ready for Jakarta EE 10! thumbnail
42:53
about 4 years ago

Get Ready for Jakarta EE 10!

Ivar Grimstad

Keep your code refactorable thumbnail
26:46
about 4 years ago

Keep your code refactorable

Gerrit Stapper

Upcoming sessions on this topic

Open session

World Congress 2026 North America

Beyond SQL Generation: How to Teach Agents What Your Database Actually Means

Kris Jenkins

Lead Developer Advocate at Snowflake

Kris Jenkins
Open session

World Congress 2026 North America

Bluesky's Open Source Moderation Tools: LLM-based Event Detection in Python

Alex Garnett

Developer Relations, Bluesky

Alex Garnett
Open session

World Congress 2026 North America

Chat with Your Data: From Natural Language to SQL

Alper Ebicoglu

Co-founder of Volosoft

Alper Ebicoglu
Open session

World Congress 2026 North America

Building Stuff with GenAI - The Open Minded Workshop beyond OpenAI

Andreas Erben

CTO for Applied AI and Metaverse at daenet

Andreas Erben
Open session

World Congress 2026 North America

From Idea to Production with AI: Agentic Development in Practice

Daniel Ostrovsky

UI/UX Architect at Payoneer | AI Architect | Full Cycle Development Expert | Public Speaker | Open Source Contributor |

Daniel Ostrovsky
Open session

World Congress 2026 North America

Building Pragmatic AI: 10 AI Features Your Users Actually Want

Jonathan "J." Tower

.NET Foundation Board | 12x Microsoft MVP | Founder & Consultant

Jonathan "J." Tower

Related videos

Add Location-based Searching to Site with ElasticSearch thumbnail
45:13
LIVE • over 5 years ago

Add Location-based Searching to Site with ElasticSearch

Derek Binkley

Boosting OpenSearch Performance: gRPC Search in Action thumbnail
24:20
Europe 2026 Virtual • about 1 month ago

Boosting OpenSearch Performance: gRPC Search in Action

Sakshi Nasha

OLAP for AI Applications and why you should care thumbnail
30:06
WWC Europe 2026 • about 1 month ago

OLAP for AI Applications and why you should care

Andrey Abramov

Distributed search under the hood thumbnail
46:58
LIVE • almost 5 years ago

Distributed search under the hood

Alexander Reelsen

Writing a full-text search engine in TypeScript thumbnail
39:39
WWC 2022 • about 4 years ago

Writing a full-text search engine in TypeScript

Michele Riva

Optimizing Discovery: PostgreSQL's Role in Transforming GetYourGuide's Search thumbnail
26:04
WWC 2025 • 12 months ago

Optimizing Discovery: PostgreSQL's Role in Transforming GetYourGuide's Search

Dharin Shah

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.