WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
World Congress 2024 • Aug 20, 2024 • Session details

Scaling Databases

Tobias Petry

Is your database crashing under the weight of a rapidly growing application? Learn to avoid premature architectural sprawl by mastering indexing, replication, and caching before tackling complex sharding.

Pause
Mute Enter Fullscreen
#1 about 3 min

Recognizing the database as the primary scaling bottleneck

Programming languages and frameworks rarely cause system failures compared to underlying database limitations.

#2 about 2 min

Optimizing database queries and implementing application caching strategies

Fixing slow queries through better indexes and applying caching should precede multi-server scaling.

#3 about 1 min

Scaling up by increasing single server hardware capacity

Upgrading server memory and CPU cores provides a simple performance boost before adopting complex topologies.

#4 about 4 min

Evaluating multi-master replication for database architectures

Synchronous dual-primary setups can introduce data conflict errors and reduce overall write performance during traffic spikes.

#5 about 3 min

Implementing read replication and managing asynchronous lag

Routing read operations to secondary servers increases capacity but requires application logic to handle asynchronous replication delays.

#6 about 3 min

Understanding the latency costs of synchronous read replication

Waiting for multiple distributed read replicas to acknowledge writes synchronously significantly degrades query execution speeds.

#7 about 4 min

Distributing data across multiple database servers with sharding

Splitting workloads across identical databases allows infinite scaling but complicates contextual data aggregation and cross-table joins.

#8 about 2 min

Managing sharding complexity with specialized database proxy solutions

Abstraction layers like Vitess and Citus manage internal routing complexities but restrict the availability of standard SQL features.

#9 about 3 min

Prioritizing architectural simplicity over infinite scalability solutions

Avoiding premature scaling optimizations and maintaining minimal database topologies prevents costly architecture rewrites and unexpected bugs.

Matching moments

3:35 min

The challenges of scaling single-node database architectures

Daniël van Eeden Daniël van Eeden +1 · World Congress 2026 Europe

6:36 min

Overcoming scaling bottlenecks caused by commercial database limitations

Werner Vogels Werner Vogels · World Congress 2025

2:19 min

Scaling infrastructure for peak application traffic patterns

Stefan Lingler Stefan Lingler +1 · Coffee With Developers

2:18 min

Scaling MySQL databases for massive user growth

Johannes Nicolai Johannes Nicolai +1 · LIVE

1:40 min

Deployment architectures for scalable multi-tenant database environments

Alper Ebicoglu Alper Ebicoglu · World Congress 2025

3:29 min

Evaluating scalability trade-offs and complexity in distributed databases

Hartmut Armbruster Hartmut Armbruster · World Congress 2024

More from World Congress 2024

Beyond the Hype: Real-World AI Strategies Panel thumbnail
24:07
12 months ago

Beyond the Hype: Real-World AI Strategies Panel

Mike Butcher, Jürgen Müller, Katrin Lehmann, Tobias Regenfuss

Carl Lapierre - Exploring Advanced Patterns in Retrieval-Augmented Generation thumbnail
21:17
almost 2 years ago

Carl Lapierre - Exploring Advanced Patterns in Retrieval-Augmented Generation

Carl Lapierre

Coding an Immersive Copilot using Unity / .NET and Azure OpenAI! thumbnail
31:50
about 2 years ago

Coding an Immersive Copilot using Unity / .NET and Azure OpenAI!

Zaid Zaim

Building a diverse tech company: The power of Diversity, Equity, Inclusion, and Belonging thumbnail
29:43
about 2 years ago

Building a diverse tech company: The power of Diversity, Equity, Inclusion, and Belonging

Sue Quackenbush

Dapr in Practice thumbnail
24:08
about 2 years ago

Dapr in Practice

marcklefter

Minimising the Carbon Footprint of Workloads thumbnail
27:46
about 2 years ago

Minimising the Carbon Footprint of Workloads

Michael Mueller

Upcoming sessions on this topic

Open session

World Congress 2026 North America

September 24, 2026 · 12:50–13:20

Stage 3

Fault Tolerance and Consistency at Scale: Harnessing the Power of Distributed SQL Databases

Wei Hu

Senior Vice President of Research and Development

Wei Hu
Open session

World Congress 2026 North America

September 24, 2026 · 14:50–15:20

Stage 2

Databases in the Agent Era

Monica Sarbu

Founder and CEO of xata.io

Monica Sarbu
Open session

World Congress 2026 North America

September 24, 2026 · 14:10–14:40

Stage 3

Real-Time Data Platforms at Trillion-Event Scale

Diptamay Sanyal

Principal Engineer | Data, AI & Cybersecurity Platforms

Diptamay Sanyal
Open session

World Congress 2026 North America

September 25, 2026 · 10:20–10:50

Stage 9

Testing React Backends Like a Pro: Mocking Databases with SQLite

David Morris

Solution Architect at Leidos

David Morris
Open session

World Congress 2026 North America

September 25, 2026 · 11:40–12:10

Stage 3

Culture Doesn't Scale Itself: Leading Engineering Teams Through Hypergrowth and the AI Transition

Thanos Baskous

VP of Engineering and Co-founder of Cogent Security

Thanos Baskous
Open session

World Congress 2026 North America

September 25, 2026 · 12:55–13:25

Stage 3

Replay-Safe Architecture: Building Event-Driven Systems That Can Recover With Confidence

Ishan Shah

PayPal, Software Engineer | Distributed Systems, AI, and Platform Engineering

Ishan Shah

Related videos

Fault Tolerance and Consistency at Scale: Harnessing the Power of Distributed SQL Databases thumbnail
32:46
World Congress 2024 • about 2 years ago

Fault Tolerance and Consistency at Scale: Harnessing the Power of Distributed SQL Databases

Wei Hu

Fault Tolerance and Consistency at Scale: Harnessing the Power of Distributed SQL Databases thumbnail
28:41
World Congress 2025 • about 1 year ago

Fault Tolerance and Consistency at Scale: Harnessing the Power of Distributed SQL Databases

Wei Hu

Why Systems Break After Initial Success: The Architectural Failures That Take Months to Surface thumbnail
26:37
Europe 2026 Virtual • 3 months ago

Why Systems Break After Initial Success: The Architectural Failures That Take Months to Surface

Christian Del Monte

Scaling: from 0 to 20 million users thumbnail
28:12
World Congress 2023 • almost 3 years ago

Scaling: from 0 to 20 million users

Josip Stuhli

The New Shiny Syndrome: How to Avoid Tech Hype Traps thumbnail
31:27
World Congress 2026 Europe • 2 months ago

The New Shiny Syndrome: How to Avoid Tech Hype Traps

Josip Stuhli

Maximising Cassandra's Potential: Tips on Schema, Queries, Parallel Access, and Reactive Programming thumbnail
31:08
World Congress 2024 • about 2 years ago

Maximising Cassandra's Potential: Tips on Schema, Queries, Parallel Access, and Reactive Programming

Hartmut Armbruster

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.