Your database is wasting modern RAM as a simple cache. Learn how a new architecture delivers predictable microsecond latency and slashes server costs.
#1about 4 minutes
The evolution of Moore's Law and its impact on software
Moore's Law drove CPU speed increases until 2005, after which the industry shifted focus from single-core performance to multi-core scalability.
#2about 2 minutes
Comparing server hardware from 2006 to 2024
Modern servers have vastly more RAM and significantly faster storage compared to 2006, fundamentally changing the ratio of memory to disk.
#3about 7 minutes
Traditional database architecture and its reliance on caching
Databases designed for limited RAM now use the extra memory in modern hardware as a cache, which sits on top of the original disk-based architecture.
#4about 6 minutes
The problems and unpredictability of database caching
Caching leads to inconsistent performance across environments and fails to improve overall application latency when multiple parallel queries are involved.
#5about 4 minutes
An alternative architecture with the index in RAM
A modern database design can leverage abundant RAM to hold the entire index in memory, enabling direct, fast access to data on SSDs without a cache.
#6about 4 minutes
Achieving speed and efficiency without caching
By using fewer resources like CPU cycles and disk I/O, an index-in-RAM architecture provides consistently fast performance and reduces infrastructure costs.
Related jobs
Jobs that call for the skills explored in this talk.
What does the history of data storage tell us about the future?In the rapidly advancing world of computing, data storage stands as a cornerstone that has evolved profoundly over the decades, adapting to meet growing demands for durability, scalability, and accessibility. From early physical storage methods to to...
Dev Digest 139 - Soft and hard queriesNews and ArticlesLet's start with Amelia Wattenberger's excellent essay Bridging the hard and the soft talking about humans and data. Do you sometimes also miss aspects of the early web like a lack of big data and freedom to create without numeric go...
30:36
24:22
41:51
50:06
30:34
21:09
28:12
30:21
