World Congress 2024 • Aug 20, 2024 • Session details

Why and when should we consider Stream Processing frameworks in our solutions

Soroosh Khodami

Are you over-engineering your data pipeline? Learn when to leverage complex stream processing frameworks like Apache Flink, and when simple SQL micro-batching is the smarter architectural choice.

Starting at 8:16 · Watch from the beginning

Why and when should we consider Stream Processing frameworks in our solutions thumbnail

Checking access…

Playback and chapters load privately for Free videos.

Matching moments

1:33 min

Overcoming typical barriers to real-time stream processing adoption

Bobur Umurzokov · LIVE

1:56 min

Overview of current stream processing frameworks

Hartmut Armbruster

Hartmut Armbruster · World Congress 2026 Europe

4:14 min

Recognizing architectural drivers pushing event streaming system adoption

Mary Grygleski

Mary Grygleski · LIVE

4:30 min

Introducing data management and the shift to streaming

Mary Grygleski

Mary Grygleski · LIVE

1:32 min

Comparing stream processing architecture to traditional batch processing

Bobur Umurzokov · LIVE

4:38 min

Operational complexities and performance optimization of stream applications

Denis Washington +1 · World Congress 2021

More from World Congress 2024

Beyond the Hype: Real-World AI Strategies Panel thumbnail

Beyond the Hype: Real-World AI Strategies Panel

Mike Butcher +3

Carl Lapierre - Exploring Advanced Patterns in Retrieval-Augmented Generation thumbnail

Carl Lapierre - Exploring Advanced Patterns in Retrieval-Augmented Generation

Carl Lapierre · Osedea

Coding an Immersive Copilot using Unity / .NET and Azure OpenAI! thumbnail

Coding an Immersive Copilot using Unity / .NET and Azure OpenAI!

Zaid Zaim · Neo4j

Building a diverse tech company: The power of Diversity, Equity, Inclusion, and Belonging thumbnail

Building a diverse tech company: The power of Diversity, Equity, Inclusion, and Belonging

Sue Quackenbush · Dynatrace

Livecoding with AI thumbnail

Livecoding with AI

Rainer Stropek · software architects

Dapr in Practice thumbnail

Dapr in Practice

marcklefter · AxonIQ

Upcoming sessions on this topic

Lessons learned after 6.7T events through PostgreSQL queues

Mihir Gandhi

Backend Engineer at RudderStack

React Under Fire: Rendering Performance for Streaming Agent UIs

Abhirupa Mitra

Slack

Senior Member of Technical Staff

A Tale of Two Systems: Design and Reality

Mandeep Singh

Kyndryl

Lead Software Engineer

How We Cut Our API's p99 Latency from Minutes to Under a Second

Deepak Agrawal

Atlassian

Principal Software Engineer

When Caches Lie: Solving Transactional Integrity and Distributed Race Conditions in Spring Boot

Shuchita Prasad

JPMorgan

Senior Lead Engineer

Designing Resumable Websockets

Prakhar Goel

Adalat AI

Platform Enginner

Related videos

What If We've Been Scaling Stream Processing Wrong All Along? thumbnail

What If We've Been Scaling Stream Processing Wrong All Along?

Hartmut Armbruster · StoatFlow

World Congress Europe · 2026

Real-Time Data Platforms at Trillion-Event Scale thumbnail

Real-Time Data Platforms at Trillion-Event Scale

Diptamay Sanyal

World Congress North America · 2026

Convert batch code into streaming with Python thumbnail

Convert batch code into streaming with Python

Bobur Umurzokov

LIVE · Feb 2024

Python-Based Data Streaming Pipelines Within Minutes thumbnail

Python-Based Data Streaming Pipelines Within Minutes

Bobur Umurzokov

LIVE · Oct 2024

Kafka Streams Microservices thumbnail

Kafka Streams Microservices

Denis Washington +1

World Congress · 2021

From event streaming to event sourcing 101 thumbnail

From event streaming to event sourcing 101

Gerard Klijs

LIVE · Dec 2020

Related articles

AA

Ali Alp

Why Event-Driven Architecture Isn’t About Speed (and When You Actually Need It)

Why Event-Driven Architecture Isn’t About Speed—And When You Actually Need It We’ve all seen it happen. An engineering team wants to feel like they belong in the “cool kids” club, so they grab Apac...

3 months ago

A developer workstation showing a code editor on one monitor, and a diagram on another

DS

Dhannush Subramani

Top Big Data Technologies That You Need to Know

Quite possibly the most advancing technology in today’s world is Big Data. It is a term that is utilised to portray an assortment of information that is immense in size and is dramatically expandin...

over 4 years ago

Top Big Data Technologies That You Need to Know

BB

Benedikt Bischof

MLops – Deploying, Maintaining And Evolving Machine Learning Models in Production

Welcome to this issue of the WeAreDevelopers Live Talk series. This article recaps an interesting talk by Bas Geerdink who gave advice on MLOps.‍About the speaker:‍Bas is a programmer, scientist, a...

about 4 years ago

MLops – Deploying, Maintaining And Evolving Machine Learning Models in Production

BB

Benedikt Bischof

Making Data Warehouses Fast: A Developer’s Story

Welcome to this issue of the WeAreDevelopers Live Talk series. This article recaps an interesting talk by Adnan Rahic who teaches the audience how to make data warehouses.About the Speaker: Adnan i...

over 4 years ago

Making Data Warehouses Fast: A Developer’s Story

From learning to earning

Jobs that call for the skills explored in this talk.

about 2 months ago • Verified

Sr. Open Source Software Engineer (Kafka)

Expert $220k–265k Remote Java Kafka Apache

6 days ago • Verified

Software Development Engineer 5

Bengaluru, India

Expert Remote Java Python Spring Boot

6 days ago • Verified

Software Development Engineer 1

Bengaluru, India

Starter Remote Java Spring

6 days ago • Verified

Director of Engineering - Data Platform SDM5

Bengaluru, India

Expert Remote ETL Spark Java EE

Software Engineer L3 Email

Beverly Hills, CA, United States

Experienced $138k–173k Remote Golang Docker Twilio

Finance Transformation - OneStream Solutions Architect, Sr. Manager

San Jose, CA, United States

Expert $124k–280k OneStream Agile Methodology