Tobias Petry
Scaling Databases
#1about 2 minutes
The database is the real bottleneck in scaling applications
Your programming language or framework is rarely the performance problem; the database is almost always the component that limits growth.
#2about 1 minute
Optimize queries and add caching before scaling out
Before distributing your database across multiple servers, you must first fix slow queries, add proper indexes, and implement caching to avoid amplifying existing problems.
#3about 1 minute
Scaling up is the simplest and most effective first step
Instead of immediately adding complexity with multiple servers, simply upgrading your existing database server with more memory and CPU cores is a cost-effective solution.
#4about 4 minutes
Understanding the trade-offs of multi-master replication
While multi-master replication allows writes to any server and guarantees read-after-write consistency, it often suffers from performance degradation due to write conflicts on the same data.
#5about 5 minutes
Using read replication to scale read-heavy workloads
Read replication uses a single primary for writes and multiple secondaries for reads, but requires careful application design to handle asynchronous replication lag and potential stale data.
#6about 5 minutes
The power and complexity of database sharding
Sharding provides near-infinite scalability by distributing data across multiple independent databases, but introduces significant complexity like cross-shard joins and managing multiple database systems.
#7about 2 minutes
Keep your database scaling strategy as simple as possible
Avoid premature optimization by choosing the simplest scaling solution that meets your current needs, as overly complex systems are difficult to manage and can lead to costly rewrites.
Related jobs
Jobs that call for the skills explored in this talk.
Matching moments
00:04 MIN
An overview of scaling a sports app to millions of users
Scaling: from 0 to 20 million users
24:06 MIN
Optimizing costs with multi-dimensional scaling
Tomorrow's cloud data platforms - fully managed database-as-a-service (DBaaS)
25:34 MIN
Key design patterns for distributed database applications
Fault Tolerance and Consistency at Scale: Harnessing the Power of Distributed SQL Databases
00:05 MIN
Understanding the fundamentals of distributed SQL databases
Fault Tolerance and Consistency at Scale: Harnessing the Power of Distributed SQL Databases
03:08 MIN
How distributed databases abstract complexity from applications
Fault Tolerance and Consistency at Scale: Harnessing the Power of Distributed SQL Databases
21:27 MIN
Scaling SSE applications for thousands of concurrent users
Streaming AI Responses in Real-Time with SSE in Next.js & NestJS
40:22 MIN
Balancing architectural complexity and business needs
The Rise of Reactive Microservices
06:37 MIN
Achieving massive scalability and high fault tolerance
Fault Tolerance and Consistency at Scale: Harnessing the Power of Distributed SQL Databases
Featured Partners
Related Videos
Scaling: from 0 to 20 million users
Josip Stuhli
Database Magic behind 40 Million operations/s
Jürgen Pilz
Fault Tolerance and Consistency at Scale: Harnessing the Power of Distributed SQL Databases
Wei Hu
Fault Tolerance and Consistency at Scale: Harnessing the Power of Distributed SQL Databases
Wei Hu
Single Server, Global Reach: Running a Worldwide Marketplace on Bare Metal in a Cloud-Dominated World
Jens Happe
How building an industry DBMS differs from building a research one
Markus Dreseler
Maximising Cassandra's Potential: Tips on Schema, Queries, Parallel Access, and Reactive Programming
Hartmut Armbruster
Branch your database like your code: How schema changes and pull requests go hand in hand
Johannes Nicolai & Lilli Seyther-Besecke
From learning to earning
Jobs that call for the skills explored in this talk.
![Senior Software Engineer [TypeScript] (Prisma Postgres)](https://wearedevelopers.imgix.net/company/283ba9dbbab3649de02b9b49e6284fd9/cover/oKWz2s90Z218LE8pFthP.png?w=400&ar=3.55&fit=crop&crop=entropy&auto=compress,format)
Senior Software Engineer [TypeScript] (Prisma Postgres)
Prisma
Remote
Senior
Node.js
TypeScript
PostgreSQL

DevOps Engineer – Kubernetes & Cloud (m/w/d)
epostbox epb GmbH
Berlin, Germany
Intermediate
Senior
DevOps
Kubernetes
Cloud (AWS/Google/Azure)

Senior Backend Developer (m/f/d)
Laserhub GmbH
Stuttgart, Germany
Remote
€70-80K
Senior
MySQL
Docker
MongoDB
+2

Full Stack Engineer
Climax.eco
Rotterdam, Netherlands
€70-100K
Senior
TypeScript
PostgreSQL
Cloud (AWS/Google/Azure)



Cloud Engineer (m/w/d)
fulfillmenttools
Köln, Germany
€50-65K
Intermediate
TypeScript
Google Cloud Platform
Continuous Integration

Lead Full-Stack Engineer
Hubert Burda Media
München, Germany
€80-95K
Intermediate
Senior
React
Vue.js
Node.js
MongoDB
+1

Domain Architect Ricardo Platform (f/m/d) | 80-100% | Hybrid working model | Valbonne France
SMG Swiss Marketplace Group
Canton de Valbonne, France
Senior