WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
World Congress 2021 • Jun 30, 2021

Kafka Streams Microservices

Denis Washington , Olli Salonen

Replacing tightly coupled microservices with Kafka Streams guarantees continuous data availability. Learn to build resilient, event-sourced architectures by treating Kafka as primary persistent storage.

Pause
Mute Enter Fullscreen
#1 about 2 min

Overcoming integration challenges with Kafka Streams microservices

Designing a robust platform to integrate disconnected cloud systems without building monolithic data silos.

#2 about 4 min

Core concepts of Apache Kafka and topic topologies

Understanding the fundamental mechanics of distributed event logs, consumer offsets, and stream topology abstractions.

#3 about 6 min

Transitioning from synchronous microservices to event sourcing

Replacing direct commands and system querying with primary event streams to eliminate tight coupling.

#4 about 4 min

Designing stream topologies and managing system failure scenarios

Leveraging stored event logs to replay historical data and maintain data read availability during outages.

#5 about 4 min

Building a consistent product catalog stream data pipeline

Aggregating, cleaning, and enriching unreliable inbound event streams into an interactive full-text search view.

#6 about 9 min

Solving race conditions and distributed state with repartitioning

Restructuring Kafka topics and IDs to enforce synchronous property validations across concurrent backend processors.

#7 about 4 min

Automating system behavior across independent event data streams

Writing processor topologies that combine separate state entities to trigger automated actions without API orchestration.

#8 about 5 min

Operational complexities and performance optimization of stream applications

Overcoming deployment pitfalls arising from transactional properties and overriding shared configurations under heavy loads.

#9 about 2 min

Blending traditional relational databases with event driven streams

Hooking classic database engines up to log publisher connectors to simplify complex unique entity logic.

#10 about 11 min

Exploring query boundaries, data storage, and architecture limits

Clarifying the practical boundaries of local processing safety, testing frameworks, and scalable long-term message compaction.

Matching moments

2:20 min

Event streaming and distributed systems with Apache Kafka

Sandon Jacobs Sandon Jacobs · World Congress 2026 North America

2:00 min

Moving from traditional databases to decoupled event streaming

Gerard Klijs · LIVE

5:43 min

Processing real-time event streams with Apache Kafka

Alex Soto Alex Soto · LIVE

3:45 min

Reviewing core Apache Kafka architecture and distributed fundamentals

Kirill Kulikov · LIVE

4:30 min

Introducing data management and the shift to streaming

Mary Grygleski Mary Grygleski · LIVE

1:56 min

Overview of current stream processing frameworks

Hartmut Armbruster Hartmut Armbruster · World Congress 2026 Europe

More from World Congress 2021

Micro Frontends with Module Federation: Why and How? thumbnail
45:40
about 5 years ago

Micro Frontends with Module Federation: Why and How?

Manfred Steyer

Data Science on Software Data thumbnail
48:10
about 5 years ago

Data Science on Software Data

Markus Harrer

The journey from developer to devops - what i've learnt along the way thumbnail
42:44
about 5 years ago

The journey from developer to devops - what i've learnt along the way

Liam Hurrel, Alireza Chegini

How Data is Shaping our Games thumbnail
43:30
about 5 years ago

How Data is Shaping our Games

Johanna Pirker

Cross platform Augmented Reality development with React Native thumbnail
40:50
over 5 years ago

Cross platform Augmented Reality development with React Native

Vladimir Novick

How to Build a Monetization Strategy Based on User's in-app Behavior thumbnail
38:59
over 5 years ago

How to Build a Monetization Strategy Based on User's in-app Behavior

Natalie Sieradzki

Upcoming sessions on this topic

Open session

How We Cut Our API's p99 Latency from Minutes to Under a Second

  • Deepak Agrawal

    Atlassian

    Principal Software Engineer

Open session

React Under Fire: Rendering Performance for Streaming Agent UIs

  • Abhirupa Mitra

    Slack

    Senior Member of Technical Staff

Open session

Multi-Cloud Isn't a Project. It's a Side Effect.

  • Antonio Mendoza Pérez

    Temporal Technologies

    Staff Developer Success Engineer

  • Gaurav Thadani

    Temporal

    Staff Developer Success Engineer

Open session

We Deleted Our Observability Stack and Rebuilt It with OTEL: 12 Engineers to 4 at 20K+ clusters

  • Yash Sharma

    DigitalOcean

    Developer Advocate

Open session

What I Got Wrong Shipping an MCP Server for Live Infrastructure

  • Pritesh Kiri

    Harness

    Developer Relations Engineer

Open session

Architecting Trusted AI: Coupling Multi-Agent Systems with dbt Semantic Store for Zero-Hallucination

  • Pushkar Mishra

    J.P. Morgan

    Senior Vice President

Related videos

The Rise of Reactive Microservices thumbnail
46:24
World Congress 2022 • over 4 years ago

The Rise of Reactive Microservices

David Leitner

From event streaming to event sourcing 101 thumbnail
27:33
LIVE • almost 6 years ago

From event streaming to event sourcing 101

Gerard Klijs

Let's Get Started With Apache Kafka® for Python Developers thumbnail
38:50
LIVE • over 3 years ago

Let's Get Started With Apache Kafka® for Python Developers

Lucia Cerchie

From Guesswork to Governance: Data Contracts Bring API Discipline to Apache Kafka thumbnail
34:30
World Congress 2026 North America • 16 days ago

From Guesswork to Governance: Data Contracts Bring API Discipline to Apache Kafka

Sandon Jacobs

What If We've Been Scaling Stream Processing Wrong All Along? thumbnail
31:06
World Congress 2026 Europe • 3 months ago

What If We've Been Scaling Stream Processing Wrong All Along?

Hartmut Armbruster

Tips, Techniques, and Common Pitfalls Debugging Kafka thumbnail
54:29
LIVE • almost 3 years ago

Tips, Techniques, and Common Pitfalls Debugging Kafka

Developersteve

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.