WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
World Congress 2021 • Jun 30, 2021

Advanced Caching Patterns used by 2000 microservices

Natan Silnitsky

How do you handle 500 billion daily requests across 2,000 microservices without cascading failures? Discover advanced caching patterns using Kafka, DynamoDB, and Varnish.

Pause
Mute Enter Fullscreen
#1 about 5 min

The necessity of caching for microservice reliability

High-scale environments use caching to decouple services and mitigate cascading failures.

#2 about 4 min

Caching strategies overview and architectural considerations

Premature caching introduces unnecessary architecture complexity before latency or scale demands it.

#3 about 4 min

Designing a read-through static configuration cache

A read-through pattern backed by object storage shields static data configuration from third-party service outages.

#4 about 11 min

Distributing cache updates using DynamoDB and Kafka

Replicating key-value updates across data centers via a change data capture topic ensures strong consistency and fast cache warmups.

#5 about 6 min

Reducing rendering latency with HTTP reverse proxies

Putting an open-source HTTP cache in front of heavy rendering services significantly decreases CPU load and response times.

#6 about 3 min

Selecting the appropriate cache type for workload requirements

A decision tree logic helps identify whether object storage, distributed databases, or proxy solutions match specific workload requirements.

#7 about 3 min

Enhancing event flows with high-level Kafka consumers

Custom SDK abstractions simplify parallel consumption and error handling in distributed event-driven architectures.

#8 about 4 min

Addressing HTTP headers and custom invalidation strategies

Handling HTTP responses and implementing accurate targeted purging rely on consistent identifier mapping across rendering pipelines.

#9 about 3 min

Mitigating cache stampedes during concurrent database misses

Strategies like increased memory limits and cluster sharding help buffer the impact of simultaneous access requests for uncached items.

#10 about 3 min

Using sidecar deployments to share JVM infrastructure

Encapsulating functionality into sidecar containers allows different language stacks to share core infrastructure without duplicating code.

#11 about 4 min

Safely handling concurrent writes with software transactional memory

Synchronizing state safely across threads using software transactional memory isolates writes and stops duplicate cache population attempts.

Matching moments

1:58 min

Trade-offs between storage and network resources in caching architectures

Pierre-Luc Noel +1 · WWC 2023

5:48 min

Balancing delivery latency with stream reliability and scale

Phil Cluff · LIVE

4:08 min

Navigating caching and downstream throttling in event-driven setups

Marco Plaul Marco Plaul +1 · WWC 2023

2:21 min

Reducing reliance on external services with caching

Michael Eder +1 · LIVE

2:44 min

Introduction to web acceleration and caching paradigms

Thijs Feryn Thijs Feryn · WWC 2025

1:11 min

Examining strategic data caching patterns via serverless capabilities

Sani Yusuf · LIVE

More from World Congress 2021

Micro Frontends with Module Federation: Why and How? thumbnail
45:40
almost 5 years ago

Micro Frontends with Module Federation: Why and How?

Manfred Steyer

Data Science on Software Data thumbnail
48:10
about 5 years ago

Data Science on Software Data

Markus Harrer

The journey from developer to devops - what i've learnt along the way thumbnail
42:44
about 5 years ago

The journey from developer to devops - what i've learnt along the way

Liam Hurrel, Alireza Chegini

How Data is Shaping our Games thumbnail
43:30
about 5 years ago

How Data is Shaping our Games

Johanna Pirker

Cross platform Augmented Reality development with React Native thumbnail
40:50
about 5 years ago

Cross platform Augmented Reality development with React Native

Vladimir Novick

How to Build a Monetization Strategy Based on User's in-app Behavior thumbnail
38:59
about 5 years ago

How to Build a Monetization Strategy Based on User's in-app Behavior

Natalie Sieradzki

Upcoming sessions on this topic

Open session

World Congress 2026 North America

KV Cache Is Not About Speed: It's About Surviving Inference Costs

David vonThenen

AI/ML Leader | Keynote Speaker | OSS Engineer & Developer Advocate | Agentic AI, Deep Learning, Production AI | Python, Go, C++

David vonThenen
Open session

World Congress 2026 North America

Boring Failover: Predictable Region Recovery Across 5,000 Microservices

Garvit Kataria, Sahil Sabharwal

Garvit Kataria
Sahil Sabharwal
Open session

World Congress 2026 North America

Microservice Cognitive Index for Deploy Diagnosis and Change Impact

Sachin Gupta

Member of Technical Staff 2 at eBay

Sachin Gupta
Open session

World Congress 2026 North America

Offloading IoT State: Solving the Memory Crisis on Legacy Hardware

Pravin Nagare

Senior Software Engineer, Roku

Pravin Nagare
Open session

World Congress 2026 North America

public void saveMoney(AI): The Developer's Guide to Unit Economics

Hrushikesh Pokala

Senior Software Engineer Lead at Equifax

Hrushikesh Pokala
Open session

World Congress 2026 North America

How to generate business value through performance optimizations

Nikolai Sidiropulo

Software Engineer at Meta

Nikolai Sidiropulo

Related videos

HTTP headers that make your website go faster thumbnail
30:27
WWC 2025 • 12 months ago

HTTP headers that make your website go faster

Thijs Feryn

Scaling: from 0 to 20 million users thumbnail
28:12
WWC 2023 • almost 3 years ago

Scaling: from 0 to 20 million users

Josip Stuhli

The Rise of Reactive Microservices thumbnail
46:24
WWC 2022 • about 4 years ago

The Rise of Reactive Microservices

David Leitner

Event based cache invalidation in GraphQL thumbnail
36:58
WWC 2022 • about 4 years ago

Event based cache invalidation in GraphQL

Simone Sanfratello

Build ultra-fast In-Memory Database Apps and Microservices with Java thumbnail
44:05
WWC 2022 • about 4 years ago

Build ultra-fast In-Memory Database Apps and Microservices with Java

Markus Kett

In-Memory Computing - The Big Picture thumbnail
30:36
WWC 2023 • almost 3 years ago

In-Memory Computing - The Big Picture

Markus Kett

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.