Adnan Rahic
Making Data Warehouses fast. A developer's story.
#1about 3 minutes
The developer's struggle with data warehouse latency
High latency in applications built on data warehouses creates a poor user experience and presents a significant challenge for developers.
#2about 5 minutes
Differentiating between OLAP and OLTP database workloads
Data warehouses use OLAP for complex, low-volume queries on large datasets, contrasting with OLTP's high-volume, simple transactions.
#3about 3 minutes
Understanding the key factors of query latency
User-perceived performance is impacted by network delays and data scan times, making sub-second responses a critical goal.
#4about 7 minutes
Exploring BigQuery's caching and concurrency limitations
BigQuery's cache only works for identical queries and its concurrency is capped per project, impacting real-world application performance.
#5about 4 minutes
Benchmarking BigQuery's performance under concurrent load
Load testing reveals that BigQuery maintains a consistent query latency of around two seconds regardless of user concurrency up to its hard limit.
#6about 2 minutes
Introducing Cube as a semantic analytics API layer
Cube provides a semantic layer over data warehouses, enabling caching, pre-aggregations, and access control to build fast data apps.
#7about 3 minutes
Setting up a local Cube development environment
A local Cube instance can be configured using Docker Compose to connect to BigQuery and automatically generate data schemas.
#8about 5 minutes
How pre-aggregations dramatically improve query speed
Pre-aggregations act as materialized views that store condensed query results, reducing a query's response time from seconds to milliseconds.
#9about 3 minutes
Comparing benchmark results of Cube vs direct BigQuery
Benchmarks show that using Cube's pre-aggregation layer results in a nearly five-fold performance increase over querying BigQuery directly.
#10about 8 minutes
Answering questions on Cube's architecture and use cases
The discussion covers when to implement a caching layer, how Cube improves performance, and its utility for medium-sized databases.
Related jobs
Jobs that call for the skills explored in this talk.
Hubert Burda Media
München, Germany
€80-95K
Intermediate
Senior
Node.js
TypeScript
Matching moments
03:28 MIN
Why corporate AI adoption lags behind the hype
What 2025 Taught Us: A Year-End Special with Hung Lee
03:39 MIN
Breaking down silos between HR, tech, and business
What 2025 Taught Us: A Year-End Special with Hung Lee
02:44 MIN
Rapid-fire thoughts on the future of work
What 2025 Taught Us: A Year-End Special with Hung Lee
04:27 MIN
Moving beyond headcount to solve business problems
What 2025 Taught Us: A Year-End Special with Hung Lee
04:22 MIN
Why HR struggles with technology implementation and adoption
What 2025 Taught Us: A Year-End Special with Hung Lee
03:15 MIN
The future of recruiting beyond talent acquisition
What 2025 Taught Us: A Year-End Special with Hung Lee
03:38 MIN
Balancing the trade-off between efficiency and resilience
What 2025 Taught Us: A Year-End Special with Hung Lee
04:57 MIN
Developing resilience by expanding your capacity for failure
What 2025 Taught Us: A Year-End Special with Hung Lee
Featured Partners
Related Videos
49:57Uncharted Territories of Web Performance - Andrew Burnett-Thompson and David Burleigh
Andrew Burnett-Thompson & David Burleigh
24:22Database Magic behind 40 Million operations/s
Jürgen Pilz
27:27Things I learned while writing high-performance JavaScript applications
Michele Riva
28:12Scaling: from 0 to 20 million users
Josip Stuhli
37:21The Data Mesh as the end of the Datalake as we know it
Mario Meir-Huber
22:32Swapping Low Latency Data Storage Under High Load
George Asafev
30:02Lessons learned from building a thriving Vue.js SaaS application
Abdelrahman Awad
43:52Web-based Information Visualization
Johanna Schmidt
Related Articles
View all articles
.gif?w=240&auto=compress,format)
From learning to earning
Jobs that call for the skills explored in this talk.
Qover
Brussels, Belgium
Senior
GIT
Bash
Python
Docker
Unit Testing
+2
Clickhouse
Amsterdam, Netherlands
Remote
Senior
ETL
Java
Spark
Kafka
+5
Workfully
Barcelona, Spain