WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
World Congress 2026 Europe • Jul 9, 2026 • Session details

Strategies for Efficient Log Management in Large-Scale Kubernetes Clusters

Aliaksandr Valialkin

Are chatty Kubernetes microservices draining your RAM and budget? Stop scaling expensive legacy clusters. Discover how VictoriaLogs shrinks petabytes of log data into gigabytes on a single node.

Pause
Mute Enter Fullscreen
#1 about 2 min

Introduction to the speaker and software development philosophy

Building highly optimized programs in the Go programming language provides simple maintenance while ensuring high performance capabilities.

#2 about 4 min

Analyzing log generation scale in Kubernetes microservice architectures

Microservices architectures produce massive daily log volumes that aggregate into enormous petabyte datasets annually.

#3 about 5 min

Challenges with relational databases and traditional log management tools

Conventional solutions like Elasticsearch, Grafana Loki, and ClickHouse struggle with managing petabyte-scale data without significant resource overhead.

#4 about 4 min

Core features and architecture of the VictoriaLogs database system

A zero-configuration logging system uses local storage disks for fast data collection without needing specialized object storage.

#5 about 2 min

Real-world compression and resource usage benchmarks for production environments

Evaluated production metrics demonstrate significant disk space reduction and minimal memory usage on a single node deployment.

#6 about 4 min

Storage formatting techniques that accelerate log metric query performance

Specialized block header architecture and optimal disk allocation enable rapid scanning when parsing aggregate timestamp conversions.

#7 about 3 min

Optimizing full-text search performance using cached massive Bloom filters

Operating system page caches hold specialized Bloom filters for exceedingly fast text identification across huge log datasets.

#8 about 6 min

Leveraging stream filters and columnar storage for rapid querying

Stream filters reduce block header scanning while columnar storage structures quickly isolate specific container metrics efficiently.

#9 about 5 min

Extrapolating single-node limitations and cluster horizontal scaling capacity models

Projecting storage hardware requirements to petabyte proportions allows cluster architectures to utilize multiple nodes for linear performance scaling.

Matching moments

4:11 min

Building a unified stack leveraging core open source tools

Mathias Palmersheim Mathias Palmersheim · Europe 2026 Virtual

3:41 min

Understanding the daily challenges of massive log volumes

Michal Bojko Michal Bojko · World Congress 2025

3:05 min

Optimizing log storage and file formats for reduced footprints

Sohan Maheshwar Sohan Maheshwar · LIVE

1:10 min

Optimizing Kubernetes clusters for resource and cost efficiency

Christian Grieger Christian Grieger · Europe 2026 Virtual

3:38 min

Diving into tiered storage operations and horizontal scaling

Mary Grygleski Mary Grygleski · LIVE

1:32 min

Minimizing infrastructure waste by reducing application log volumes

Pierre-Luc Noel +1 · World Congress 2023

More from World Congress 2026 Europe

Building the Nervous System of AI - Michael Kagan (NVIDIA) thumbnail
29:17
3 months ago

Building the Nervous System of AI - Michael Kagan (NVIDIA)

Michael Kagan, Sead Ahmetović

Five Things in Tech that Matter Now - WeAreDevelopers World Congress 2026 Closing Keynote thumbnail
19:41
3 months ago

Five Things in Tech that Matter Now - WeAreDevelopers World Congress 2026 Closing Keynote

Christian Heilmann

The Sound of Your Secrets: Teaching Your Model to Spy, So You Can Learn to Defend thumbnail
32:06
3 months ago

The Sound of Your Secrets: Teaching Your Model to Spy, So You Can Learn to Defend

David vonThenen

Super scaling for the Super Bowl: How to survive 30 million users hitting your backend in 30 minutes thumbnail
35:13
3 months ago

Super scaling for the Super Bowl: How to survive 30 million users hitting your backend in 30 minutes

Irina Branovic

Running Secure Life Science Research at Scale using Hybrid GPU HPC and Kubernetes 🧬 thumbnail
24:23
3 months ago

Running Secure Life Science Research at Scale using Hybrid GPU HPC and Kubernetes 🧬

Jeremy Murray

Angstfreude - AI and Corporate Culture - The Thrill and the Threat thumbnail
30:26
3 months ago

Angstfreude - AI and Corporate Culture - The Thrill and the Threat

Axel Ebert, Karin Krobath

Upcoming sessions on this topic

Open session

We Deleted Our Observability Stack and Rebuilt It with OTEL: 12 Engineers to 4 at 20K+ clusters

  • Yash Sharma

    DigitalOcean

    Developer Advocate

Open session

How We Cut Our API's p99 Latency from Minutes to Under a Second

  • Deepak Agrawal

    Atlassian

    Principal Software Engineer

Open session

How 8 GPUs Became 16: Rethinking LLM Inference Through Parallelism, Memory, and Runtime Design

  • Purnima Kumari

    DigitalOCean

    Sr. Solutions Architect II

Open session

React Under Fire: Rendering Performance for Streaming Agent UIs

  • Abhirupa Mitra

    Slack

    Senior Member of Technical Staff

Open session

From Profiler to Production: Measuring What Actually Matters in React & React Native

  • Andrei Tazetdinov

    Dynatrace

    React Native Developer

Open session

Architecting Trusted AI: Coupling Multi-Agent Systems with dbt Semantic Store for Zero-Hallucination

  • Pushkar Mishra

    J.P. Morgan

    Senior Vice President

Related videos

Logs in observability - Correlation thumbnail
23:09
World Congress 2025 • about 1 year ago

Logs in observability - Correlation

Michal Bojko

It's all about the Data thumbnail
30:35
World Congress 2022 • over 4 years ago

It's all about the Data

Michael Cade

5 steps for running a Kubernetes environment at scale thumbnail
57:09
LIVE • almost 6 years ago

5 steps for running a Kubernetes environment at scale

Stijn Polfliet

How I saved 200K/yr in direct costs writing 0 code lines in K8s thumbnail
19:36
World Congress 2024 • about 2 years ago

How I saved 200K/yr in direct costs writing 0 code lines in K8s

Ingvord

Real-Time Data Platforms at Trillion-Event Scale thumbnail
26:39
World Congress 2026 North America • 22 days ago

Real-Time Data Platforms at Trillion-Event Scale

Diptamay Sanyal

Run your agents in Kubernetes: Build once, deploy anywhere. But really? thumbnail
21:26
World Congress 2026 North America • 22 days ago

Run your agents in Kubernetes: Build once, deploy anywhere. But really?

Michal Salanci

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.