WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
World Congress 2026 Europe • Jul 9, 2026 • Session details

Strategies for Efficient Log Management in Large-Scale Kubernetes Clusters

Aliaksandr Valialkin

Are chatty Kubernetes microservices draining your RAM and budget? Stop scaling expensive legacy clusters. Discover how VictoriaLogs shrinks petabytes of log data into gigabytes on a single node.

Pause
Mute Enter Fullscreen
#1 about 2 min

Introduction to the speaker and software development philosophy

Building highly optimized programs in the Go programming language provides simple maintenance while ensuring high performance capabilities.

#2 about 4 min

Analyzing log generation scale in Kubernetes microservice architectures

Microservices architectures produce massive daily log volumes that aggregate into enormous petabyte datasets annually.

#3 about 5 min

Challenges with relational databases and traditional log management tools

Conventional solutions like Elasticsearch, Grafana Loki, and ClickHouse struggle with managing petabyte-scale data without significant resource overhead.

#4 about 4 min

Core features and architecture of the VictoriaLogs database system

A zero-configuration logging system uses local storage disks for fast data collection without needing specialized object storage.

#5 about 2 min

Real-world compression and resource usage benchmarks for production environments

Evaluated production metrics demonstrate significant disk space reduction and minimal memory usage on a single node deployment.

#6 about 4 min

Storage formatting techniques that accelerate log metric query performance

Specialized block header architecture and optimal disk allocation enable rapid scanning when parsing aggregate timestamp conversions.

#7 about 3 min

Optimizing full-text search performance using cached massive Bloom filters

Operating system page caches hold specialized Bloom filters for exceedingly fast text identification across huge log datasets.

#8 about 6 min

Leveraging stream filters and columnar storage for rapid querying

Stream filters reduce block header scanning while columnar storage structures quickly isolate specific container metrics efficiently.

#9 about 5 min

Extrapolating single-node limitations and cluster horizontal scaling capacity models

Projecting storage hardware requirements to petabyte proportions allows cluster architectures to utilize multiple nodes for linear performance scaling.

Matching moments

4:11 min

Building a unified stack leveraging core open source tools

Mathias Palmersheim Mathias Palmersheim · Europe 2026 Virtual

3:41 min

Understanding the daily challenges of massive log volumes

Michal Bojko Michal Bojko · World Congress 2025

3:05 min

Optimizing log storage and file formats for reduced footprints

Sohan Maheshwar · LIVE

1:10 min

Optimizing Kubernetes clusters for resource and cost efficiency

Christian Grieger Christian Grieger · Europe 2026 Virtual

3:38 min

Diving into tiered storage operations and horizontal scaling

Mary Grygleski Mary Grygleski · LIVE

1:32 min

Minimizing infrastructure waste by reducing application log volumes

Pierre-Luc Noel +1 · World Congress 2023

More from World Congress 2026 Europe

Building the Nervous System of AI - Michael Kagan (NVIDIA) thumbnail
29:17
about 2 months ago

Building the Nervous System of AI - Michael Kagan (NVIDIA)

Michael Kagan, Sead Ahmetović

Five Things in Tech that Matter Now - WeAreDevelopers World Congress 2026 Closing Keynote thumbnail
19:41
about 2 months ago

Five Things in Tech that Matter Now - WeAreDevelopers World Congress 2026 Closing Keynote

Christian Heilmann

The Sound of Your Secrets: Teaching Your Model to Spy, So You Can Learn to Defend thumbnail
32:06
about 2 months ago

The Sound of Your Secrets: Teaching Your Model to Spy, So You Can Learn to Defend

David vonThenen

Super scaling for the Super Bowl: How to survive 30 million users hitting your backend in 30 minutes thumbnail
35:13
about 2 months ago

Super scaling for the Super Bowl: How to survive 30 million users hitting your backend in 30 minutes

Irina Branovic

Running Secure Life Science Research at Scale using Hybrid GPU HPC and Kubernetes 🧬 thumbnail
24:23
about 2 months ago

Running Secure Life Science Research at Scale using Hybrid GPU HPC and Kubernetes 🧬

Jeremy Murray

Angstfreude - AI and Corporate Culture - The Thrill and the Threat thumbnail
30:26
about 2 months ago

Angstfreude - AI and Corporate Culture - The Thrill and the Threat

Axel Ebert, Karin Krobath

Upcoming sessions on this topic

Open session

World Congress 2026 North America

September 24, 2026 · 14:50–15:20

Stage 4

When Logging Becomes The Outage: Escaping the ECS Logging Trap

Rahul Tanniru

Senior Vice President Of Software Engineering, Jp Morgan Chase

Rahul Tanniru
Open session

World Congress 2026 North America

September 24, 2026 · 14:10–14:40

Stage 3

Real-Time Data Platforms at Trillion-Event Scale

Diptamay Sanyal

Principal Engineer | Data, AI & Cybersecurity Platforms

Diptamay Sanyal
Open session

World Congress 2026 North America

September 24, 2026 · 15:30–16:00

Stage 9

Run your agents in Kubernetes: Build once, deploy anywhere. But really?

Michal Salanci

Senior Systems Engineer at ESET Cybersecurity

Michal Salanci
Open session

World Congress 2026 North America

September 24, 2026 · 15:30–16:00

Stage 1

KV Cache Is Not About Speed: It's About Surviving Inference Costs

David vonThenen

AI/ML Leader | Keynote Speaker | OSS Engineer & Developer Advocate | Agentic AI, Deep Learning, Production AI | Python, Go, C++

David vonThenen
Open session

World Congress 2026 North America

September 25, 2026 · 16:00–16:10

Outdoor Stage

public void saveMoney(AI): The Developer's Guide to Unit Economics

Hrushikesh Pokala

Senior Software Engineer Lead at Equifax

Hrushikesh Pokala
Open session

World Congress 2026 North America

September 24, 2026 · 17:30–18:00

Stage 4

Boring Failover: Predictable Region Recovery Across 5,000 Microservices

Garvit Kataria, Sahil Sabharwal

Garvit Kataria
Sahil Sabharwal

Related videos

Logs in observability - Correlation thumbnail
23:09
World Congress 2025 • about 1 year ago

Logs in observability - Correlation

Michal Bojko

It's all about the Data thumbnail
30:35
World Congress 2022 • about 4 years ago

It's all about the Data

Michael Cade

5 steps for running a Kubernetes environment at scale thumbnail
57:09
LIVE • almost 6 years ago

5 steps for running a Kubernetes environment at scale

Stijn Polfliet

How I saved 200K/yr in direct costs writing 0 code lines in K8s thumbnail
19:36
World Congress 2024 • about 2 years ago

How I saved 200K/yr in direct costs writing 0 code lines in K8s

Ingvord

Software Engineering Social Connection: Yubo’s lean approach to scaling an 80M-user infrastructure thumbnail
17:44
World Congress 2025 • about 1 year ago

Software Engineering Social Connection: Yubo’s lean approach to scaling an 80M-user infrastructure

Mikael Robert

Understanding Kubernetes in a visual way thumbnail
29:05
World Congress 2026 Europe • about 2 months ago

Understanding Kubernetes in a visual way

Aurélie Vache

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.