WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
World Congress 2023 • Sep 21, 2023

Scaling: from 0 to 20 million users

Josip Stuhli

To survive 1.7 million concurrent connections, SofaScore abandoned the cloud. Discover how migrating from AWS to bare-metal servers slashed their infrastructure costs to just 0.8% of revenue.

Pause
Mute Enter Fullscreen
#1 about 2 min

Overview of application scale and exponential growth

How an exponentially growing sports app handles billions of requests with a PHP backend.

#2 about 1 min

Surviving traffic spikes on a single shared server

A basic shared server setup crashes when overwhelmed by thousands of live users.

#3 about 2 min

Adding Memcached and experiencing cache stampede problems

Adding memory caching improved user capacity but led to backend crashes during cache expiration.

#4 about 2 min

Using proactive caching to compute data before expiration

Background workers recalculate and cache live data before expiration to prevent extreme database load.

#5 about 3 min

Scaling huge traffic spikes with static HTML files

Rendering pages as static files over FTP handles overwhelming server load before major sporting events.

#6 about 3 min

Migrating to AWS and utilizing Varnish for caching

Moving to AWS involves deploying stateless application images and using Varnish for request coalescing.

#7 about 2 min

Realizing the limitations of MongoDB for live statistics

Data type errors, poor analytics capabilities, and lack of locking plague the initial MongoDB deployment.

#8 about 2 min

Live migration to PostgreSQL for relational analytics features

Switching the primary database to PostgreSQL on the fly grants advanced SQL capabilities, foreign keys, and stability.

#9 about 2 min

Shifting caching layers in front of backend servers

Deploying load balancers and sharding techniques ensures cache efficiency and protects backend databases during upgrades.

#10 about 2 min

Moving from AWS to on-premise servers for cost reduction

Migrating out of the public cloud to private data center servers eliminates excessively high bandwidth pricing.

#11 about 2 min

Mitigating traffic spikes generated by real-time push notifications

Custom Cloudflare rules whitelist massive inbound traffic waves caused by millions of devices opening simultaneous push notifications.

#12 about 2 min

Monitoring application load and supplementing with virtual machines

Application performance monitoring tools reveal bottlenecks while dynamic virtual machines handle temporary capacity shortages.

#13 about 3 min

Utilizing global edge nodes and geo-routing strategies

Caching content at international edge nodes drastically decreases global load times for users outside the primary data center.

#14 about 1 min

Setting up bare-metal Kubernetes for multi-datacenter redundancies

On-premise Kubernetes deployments ease infrastructure updates and ensure failover safety after datacenters experience severe outages.

#15 about 2 min

Broadcasting lightning fast application updates using NATS messaging

Transitioning clients from long polling to NATS pub/sub networks delivers lightning fast dashboard updates.

#16 about 2 min

Powering machine learning models using ClickHouse database scale

The ClickHouse database efficiently stores and analyzes petabytes of analytical sports data locally at minimal hardware costs.

#17 about 2 min

Emphasizing statelessness, caching, and delayed processing architectures

Core scaling takeaways include keeping infrastructure stateless, personalizing cached data effectively, and actively queuing slow tasks.

#18 about 2 min

Handling metrics pipelines, geo-routing, and Kubernetes workload isolation

Monitoring live systems requires pipelines to InfluxDB, while stateful endpoints like databases remain outside the bare-metal Kubernetes cluster.

Matching moments

3:42 min

Managing high-traffic infrastructure without chasing technology hype

Josip Stuhli Josip Stuhli · Coffee With Developers

1:52 min

Boosting scale and lowering latency natively with NoSQL

Tim Faulkes · LIVE

1:38 min

Handling unexpected traffic spikes without proper load testing

Andreas Taranetz Andreas Taranetz · World Congress 2024

4:36 min

Hiring passionate software engineers to tackle unprecedented scaling challenges

Dana Lawson Dana Lawson +1 · World Congress 2026 Europe

3:32 min

Overcoming traffic burst challenges in hyperscale web applications

Marco Plaul Marco Plaul +1 · World Congress 2023

6:36 min

Overcoming scaling bottlenecks caused by commercial database limitations

Werner Vogels Werner Vogels · World Congress 2025

More from World Congress 2023

The year 3000, a brief history of Web Development thumbnail
25:30
over 2 years ago

The year 3000, a brief history of Web Development

Lorenzo Pieri

Demografie nutzen um jedem Bewerber das passende Angebot zu machen! thumbnail
8:52
almost 3 years ago

Demografie nutzen um jedem Bewerber das passende Angebot zu machen!

Nathalie Gierth

Guided Memory Management: Rust's Ownership Model thumbnail
0:18
almost 3 years ago

Guided Memory Management: Rust's Ownership Model

Stefan Baumgartner

Passwordless future: WebAuthn and Passkeys in practice thumbnail
32:32
almost 3 years ago

Passwordless future: WebAuthn and Passkeys in practice

Clemens Hübner

External Secrets Operator: the secrets management toolbox for self-sufficient teams thumbnail
30:07
almost 3 years ago

External Secrets Operator: the secrets management toolbox for self-sufficient teams

Moritz Johner

Building Reliable Serverless Applications with AWS CDK and Testing thumbnail
25:18
almost 3 years ago

Building Reliable Serverless Applications with AWS CDK and Testing

Raphael Manke

Upcoming sessions on this topic

Open session

How We Cut Our API's p99 Latency from Minutes to Under a Second

  • Deepak Agrawal

    Atlassian

    Principal Software Engineer

Open session

We Deleted Our Observability Stack and Rebuilt It with OTEL: 12 Engineers to 4 at 20K+ clusters

  • Yash Sharma

    DigitalOcean

    Developer Advocate

Open session

Shipping MCP to Real Users: Scaling, Auth, and the PII Leak You Didn't See Coming

  • Hadar Geva

    Myop

    CTO & Co-founder

Open session

Multi-Cloud Isn't a Project. It's a Side Effect.

  • Antonio Mendoza Pérez

    Temporal Technologies

    Staff Developer Success Engineer

  • Gaurav Thadani

    Temporal

    Staff Developer Success Engineer

Open session

React Under Fire: Rendering Performance for Streaming Agent UIs

  • Abhirupa Mitra

    Slack

    Senior Member of Technical Staff

Open session

From Profiler to Production: Measuring What Actually Matters in React & React Native

  • Andrei Tazetdinov

    Dynatrace

    React Native Developer

Related videos

Super scaling for the Super Bowl: How to survive 30 million users hitting your backend in 30 minutes thumbnail
35:13
World Congress 2026 Europe • 3 months ago

Super scaling for the Super Bowl: How to survive 30 million users hitting your backend in 30 minutes

Irina Branovic

Swapping Low Latency Data Storage Under High Load thumbnail
22:32
World Congress 2023 • about 3 years ago

Swapping Low Latency Data Storage Under High Load

George Asafev

The New Shiny Syndrome: How to Avoid Tech Hype Traps thumbnail
31:27
World Congress 2026 Europe • 3 months ago

The New Shiny Syndrome: How to Avoid Tech Hype Traps

Josip Stuhli

Scaling Databases thumbnail
21:09
World Congress 2024 • about 2 years ago

Scaling Databases

Tobias Petry

From 0 to 1.000.000: How to build a serverless raffle service for hyperscale thumbnail
30:03
World Congress 2023 • almost 3 years ago

From 0 to 1.000.000: How to build a serverless raffle service for hyperscale

Marco Plaul, Martin Sakowski

Advanced Caching Patterns used by 2000 microservices thumbnail
44:37
World Congress 2021 • over 5 years ago

Advanced Caching Patterns used by 2000 microservices

Natan Silnitsky

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.