WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
JavaScript Congress • Nov 24, 2021

Making Data Warehouses fast. A developer's story.

Adnan Rahic

Standard caching won't fix unpredictable data warehouse response lags. Learn how one developer used Cube's semantic API to unlock 200-millisecond queries without complex SQL tuning.

Pause
Mute Enter Fullscreen
#1 about 4 min

Navigating data warehouse performance for application developers

Grasping the challenges of massive analytical datasets is the first step to building responsive data applications.

#2 about 3 min

Understanding the fundamental differences between analytical and transactional processing

Defining data warehouses reveals why low-volume complex queries require entirely different architectures than traditional transactional databases.

#3 about 2 min

Utilizing materialized views and multi-dimensional cubes for scale

Bridging the gap between scanning vast amounts of data and handling higher query volumes requires pre-computed analytical results.

#4 about 4 min

Evaluating physical constraints and network limits on query latency

Achieving instantaneous application response times under network constraints requires understanding how data volume shapes subsecond query execution.

#5 about 4 min

Explaining query execution overhead and caching limitations in BigQuery

Serverless data warehouses struggle with subsecond latency due to query planning overhead and strict exact-match caching rules.

#6 about 3 min

Managing query concurrency and quota limits in cloud datasets

Hitting high parallel execution reveals project-level query caps that throttle active application requests and queue operations.

#7 about 4 min

Benchmarking cloud data warehouses under concurrent artificial user load

Uncached execution testing reveals hard concurrency ceilings and unchanged percentile latency distributions in serverless data structures.

#8 about 4 min

Implementing an analytics API layer with open source tools

Using a semantic layer to condense source data drastically reduces execution processing and retains high application concurrency.

#9 about 4 min

Configuring local development environments for automated schema generation

Connecting an open-source semantic layer to a cloud warehouse automates data schema generation via zero-code interfaces.

#10 about 5 min

Deploying pre-aggregations and materialized views in production systems

Scaling analytics requires dedicated infrastructure to pre-compute and store aggregated tables separately from raw database storage.

#11 about 4 min

Comparing benchmark outcomes between direct queries and semantic layers

Bypassing raw data scans with pre-aggregated structures yields massive throughput improvements and subsecond application responses.

#12 about 8 min

Integrating analytics APIs across small applications and mid-sized databases

Overcoming initial data scaling challenges requires timing the introduction of semantic cache layers regardless of underlying database size.

Matching moments

1:21 min

Summary of decoupling analytical compute and storage

Matthias Niehoff Matthias Niehoff · World Congress 2026 Europe

3:29 min

Practical use cases for unified transactional and analytical databases

Oleksandra Bovkun Oleksandra Bovkun · Europe 2026 Virtual

5:00 min

Q&A on analytical databases and market convergence

Andrey Abramov Andrey Abramov · World Congress 2026 Europe

7:52 min

Audience questions on database performance, deployments, and data migrations

Gregor Bauer Gregor Bauer · LIVE

2:36 min

Modern application stacks and real-time data requirements

Tim Faulkes · LIVE

3:58 min

Struggling with ungoverned data lakes and massive storage costs

Kateřina Ščavnická Kateřina Ščavnická · World Congress 2025

More from JavaScript Congress

The Eternal Sunshine of the Zero Build Pipeline thumbnail
50:10
almost 5 years ago

The Eternal Sunshine of the Zero Build Pipeline

Teini - an extremely small webshop leveraging awesome and free tech thumbnail
40:45
almost 5 years ago

Teini - an extremely small webshop leveraging awesome and free tech

Christian K

Native Web Apps: Are We There Yet? thumbnail
44:40
almost 5 years ago

Native Web Apps: Are We There Yet?

Maxim Salnikov

Modern Web Development with Nuxt3 thumbnail
41:43
almost 5 years ago

Modern Web Development with Nuxt3

Alexander Lichter

Making neural networks portable with ONNX thumbnail
54:49
almost 5 years ago

Making neural networks portable with ONNX

Ron Dagdag

JavaScript the Grumpy Parts thumbnail
46:08
almost 5 years ago

JavaScript the Grumpy Parts

Rob Richardson

Upcoming sessions on this topic

Open session

World Congress 2026 North America

September 24, 2026 · 14:10–14:40

Stage 7

Designing High-Performance AI APIs: Lessons from Serving Millions of Real-Time Requests

Wayne Liu

Chief Growth Officer and Americas President of Perfect Corp.

Wayne Liu
Open session

World Congress 2026 North America

September 24, 2026 · 14:50–15:20

Stage 2

Databases in the Agent Era

Monica Sarbu

Founder and CEO of xata.io

Monica Sarbu
Open session

World Congress 2026 North America

September 24, 2026 · 14:10–14:40

Stage 1

Anatomy of an AI Request: Where Latency and Cost Are Really Born

Dan Fu

VP of Kernels at Together AI

Dan Fu
Open session

World Congress 2026 North America

September 24, 2026 · 15:30–16:00

Stage 2

KV Cache Is Not About Speed: It's About Surviving Inference Costs

David vonThenen

AI/ML Leader | Keynote Speaker | OSS Engineer & Developer Advocate | Agentic AI, Deep Learning, Production AI | Python, Go, C++

David vonThenen
Open session

World Congress 2026 North America

September 25, 2026 · 16:00–16:10

Outdoor Stage

public void saveMoney(AI): The Developer's Guide to Unit Economics

Hrushikesh Pokala

Senior Software Engineer Lead at Equifax

Hrushikesh Pokala
Open session

World Congress 2026 North America

September 25, 2026 · 11:40–12:10

Stage 9

You Can’t Re-Run Sunlight: Designing ML Data Architectures for Physical AI

An Phan

Senior Data Infrastructure Engineer @ Hippo Harvest

An Phan

Related videos

How building an industry DBMS differs from building a research one thumbnail
30:34
World Congress 2023 • almost 3 years ago

How building an industry DBMS differs from building a research one

Markus Dreseler

In-Memory Computing - The Big Picture thumbnail
30:36
World Congress 2023 • about 3 years ago

In-Memory Computing - The Big Picture

Markus Kett

Parquet, Delta, Iceberg & Ducklake - An introduction for developers thumbnail
28:42
World Congress 2026 Europe • 2 months ago

Parquet, Delta, Iceberg & Ducklake - An introduction for developers

Matthias Niehoff

Leveraging Real time data in FSIs thumbnail
41:51
LIVE • almost 3 years ago

Leveraging Real time data in FSIs

Tim Faulkes

Swapping a Data Warehouse at Runtime: Zero-Downtime Migration Without Changing a Single Client thumbnail
30:28
World Congress 2026 Europe • 2 months ago

Swapping a Data Warehouse at Runtime: Zero-Downtime Migration Without Changing a Single Client

Max Fischer, Michael O'Toole

Modern Data Architectures need Software Engineering thumbnail
29:25
World Congress 2024 • about 2 years ago

Modern Data Architectures need Software Engineering

Matthias Niehoff

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.