WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
WeAreDevelopers LIVE • Apr 18, 2023

Event Messaging and Streaming with Apache Pulsar

Mary Grygleski

Does your streaming architecture suffer from scaling bottlenecks? Learn how Apache Pulsar's separation of compute and storage enables robust, low-latency event messaging at global scale.

Pause
Mute Enter Fullscreen
#1 about 5 min

Introducing data management and the shift to streaming

Reviewing background experience with scalable databases and defining the agenda for distributed event processing.

#2 about 4 min

Understanding data in motion and foundational messaging concepts

Recognizing how continuous event streaming represents changing data states sequentially across space and time.

#3 about 5 min

Clarifying terminology around different event computing software forms

Distinguishing between complex architectures like event sourcing, event-driven design, and localized reactive systems.

#4 about 4 min

Defining complex event processing and actionable continuous streams

Analyzing data series to identify real-time patterns for targeted operations like fraud detection.

#5 about 5 min

Comparing pub-sub architectures with message queuing point delivery

Analyzing differences between topic-based message broadcasting and queue-based direct consumption for system services.

#6 about 5 min

Recognizing architectural drivers pushing event streaming system adoption

Highlighting the need for real-time memory processing and immediate data ingestion over traditional batch loads.

#7 about 7 min

Evaluating cloud-native fundamentals within the pulsar open ecosystem

Unpacking the decoupled compute and storage framework supporting massive scale and automated multi-tenant workloads.

#8 about 4 min

Diving into tiered storage operations and horizontal scaling

Leveraging distinct stateless brokers and localized log managers to spread network loads evenly.

#9 about 4 min

Highlighting core enterprise differentiators and adaptable subscription parameters

Supporting active geo-replication constraints and configuring explicit consumption models tailored to multi-tenant environments.

#10 about 4 min

Transforming data pipelines natively through lightweight serverless functions

Enriching raw data dynamically using integrated schema registries and versatile input-output platform connectors.

#11 about 4 min

Managing cloud clusters and validating provisioned streaming endpoints

Creating designated database environments and verifying active pipeline connections through a centralized graphical framework.

#12 about 11 min

Securing topic access and prioritizing inclusive community involvement

Discussing localized token authentication practices and outlining the advantages of contributing actively to software communities.

Matching moments

1:11 min

Comparing cloud-based message broker and event stream solutions

Clemens Vasters Clemens Vasters · World Congress 2022

2:00 min

Moving from traditional databases to decoupled event streaming

Gerard Klijs · LIVE

3:06 min

Core concepts of Apache Kafka and topic topologies

Denis Washington +1 · World Congress 2021

49 sec

Processing asynchronous event streams via standard messaging patterns

Patrick Koss Patrick Koss · World Congress 2024

2:13 min

Modernizing legacy applications for real-time streaming data consumption

Farooq Sheikh Farooq Sheikh +3 · World Congress 2025

57 sec

Overview of the Kusto big data analytics platform

Prof Smoke Prof Smoke · World Congress 2025

More from WeAreDevelopers LIVE

WeAreDevelopers LIVE - Is CSS Catching Up to Flash? thumbnail
1:03:33
12 days ago

WeAreDevelopers LIVE - Is CSS Catching Up to Flash?

Chris Heilmann, Daniel Cranney, Bramus Van Damme

WeAreDevelopers LIVE - Project Chopin: Make Your Team and Agents Play Along thumbnail
1:21:17
19 days ago

WeAreDevelopers LIVE - Project Chopin: Make Your Team and Agents Play Along

Chris Heilmann, Daniel Cranney, Krzysztof Cieślak

Fake or News - AI Toothbrushes, Carrier Pigeon Tech & Life on Mars - Krzysztof Cieślak thumbnail
4:23
21 days ago

Fake or News - AI Toothbrushes, Carrier Pigeon Tech & Life on Mars - Krzysztof Cieślak

Chris Heilmann, Daniel Cranney

WeAreDevelopers LIVE - Open Source Agent Toolkits thumbnail
1:00:38
26 days ago

WeAreDevelopers LIVE - Open Source Agent Toolkits

Chris Heilmann, Daniel Cranney, Eddie Jaoude

Fake or News - AI Music Detectors, Translating Ancient Languages & Tiny Heads in Teslas - Eddie Jaoude thumbnail
6:16
28 days ago

Fake or News - AI Music Detectors, Translating Ancient Languages & Tiny Heads in Teslas - Eddie Jaoude

Chris Heilmann, Daniel Cranney

Fake or News: AI Agents Hire Each Other, Spider-Man Ads in Cars & RAM Thieves - Marc Plogas thumbnail
5:46
about 1 month ago

Fake or News: AI Agents Hire Each Other, Spider-Man Ads in Cars & RAM Thieves - Marc Plogas

Chris Heilmann, Daniel Cranney, Marc Plogas

Related videos

Why and when should we consider Stream Processing frameworks in our solutions thumbnail
30:51
World Congress 2024 • about 2 years ago

Why and when should we consider Stream Processing frameworks in our solutions

Soroosh Khodami

Kafka Streams Microservices thumbnail
45:48
World Congress 2021 • about 5 years ago

Kafka Streams Microservices

Denis Washington, Olli Salonen

Let's Get Started With Apache Kafka® for Python Developers thumbnail
38:50
LIVE • over 3 years ago

Let's Get Started With Apache Kafka® for Python Developers

Lucia Cerchie

From event streaming to event sourcing 101 thumbnail
27:33
LIVE • almost 6 years ago

From event streaming to event sourcing 101

Gerard Klijs

Implementing an Event Sourcing strategy on Azure thumbnail
32:03
World Congress 2023 • about 3 years ago

Implementing an Event Sourcing strategy on Azure

Eldert Grootenboer, Olena Borzenko-Turianska

Python-Based Data Streaming Pipelines Within Minutes thumbnail
39:04
LIVE • almost 2 years ago

Python-Based Data Streaming Pipelines Within Minutes

Bobur Umurzokov

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.