WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
World Congress 2023 • Sep 27, 2023

Implementing an Event Sourcing strategy on Azure

Eldert Grootenboer , Olena Borzenko-Turianska

Are CRUD bottlenecks limiting your application's scale? Discover how to architect an append-only event sourcing strategy on Azure to unlock infinite scalability and lightning-fast materialized views.

Pause
Mute Enter Fullscreen
#1 about 3 min

Understanding the basics of event sourcing patterns

Replaying sequential events rebuilds the current state of an entity.

#2 about 4 min

Solving traditional database locking and scaling challenges

Insert-only workloads eliminate update locks and provide built-in audit trails.

#3 about 1 min

Scaling event sourcing systems in cloud environments

Cloud platforms natively support high-throughput insert operations for massive scale.

#4 about 3 min

Storing events using globally distributed databases

Multimodal document databases offer native change feeds for separation of commands and queries.

#5 about 2 min

Ingesting streaming data securely with managed hubs

Fully managed ingestion engines capture millions of stream messages per second without exposing data stores.

#6 about 1 min

Publishing discrete event notifications for broad consumption

System triggers send independent push notifications to alert external applications of status changes.

#7 about 1 min

Managing intent-based workloads using message queues

Reliable messaging queues handle explicit transactional commands and prevent data loss during processing failures.

#8 about 3 min

Processing event streams linearly through serverless compute

Native platform bindings eliminate boilerplate code when deploying reactive cloud processing units.

#9 about 3 min

Designing data ingestion architecture with system integration

Swapping connection strings migrates existing external streaming applications directly into managed cloud infrastructure.

#10 about 3 min

Routing discrete events to trigger independent workflows

Aggregating historical records uncovers the necessary operational context to execute downstream automated tasks.

#11 about 3 min

Options for extracting and processing historical events

Pulling batches, subscribing to real-time pushes, or running automated scripts determines how data gets consumed.

#12 about 4 min

Precalculating queries using automatic materialized views

Aggregating transactional data immediately upon insertion optimizes subsequent application read performance.

#13 about 2 min

Embracing data duplication to replace complex normalization

Duplicating aggregate data across distinct partition keys avoids expensive relational joins.

#14 about 2 min

Integrating analytical dashboards and real-time client notifications

Downstream applications consume preprocessed snapshots to instantly drive live analytics and interactive experiences.

#15 about 3 min

Benefits of adopting scalable event sourcing architecture

Append-only persistent stores combine natively with serverless components to securely manage extreme enterprise workloads.

#16 about 2 min

Handling data retention and archiving in event stores

Continuous changelogs naturally retain historical actions to simplify data recovery and long-term storage.

Matching moments

3:19 min

Core principles of transitioning to full event sourcing

Gerard Klijs · LIVE

8:24 min

Exploring orchestration scalability and database architecture tradeoffs

Bernd Ruecker Bernd Ruecker · LIVE

5:37 min

Transitioning from synchronous microservices to event sourcing

Denis Washington +1 · World Congress 2021

6:15 min

Routing events between sources and handlers with event grid

Menaka Baskerpillai · LIVE

2:08 min

Introducing beneficial architectural patterns like event sourcing

Stefan Priebsch · World Congress 2021

4:28 min

Differentiating event streaming from true event sourcing

Allard Buijze · World Congress 2021

More from World Congress 2023

The year 3000, a brief history of Web Development thumbnail
25:30
over 2 years ago

The year 3000, a brief history of Web Development

Lorenzo Pieri

Demografie nutzen um jedem Bewerber das passende Angebot zu machen! thumbnail
8:52
almost 3 years ago

Demografie nutzen um jedem Bewerber das passende Angebot zu machen!

Nathalie Gierth

Guided Memory Management: Rust's Ownership Model thumbnail
0:18
almost 3 years ago

Guided Memory Management: Rust's Ownership Model

Stefan Baumgartner

Passwordless future: WebAuthn and Passkeys in practice thumbnail
32:32
almost 3 years ago

Passwordless future: WebAuthn and Passkeys in practice

Clemens Hübner

External Secrets Operator: the secrets management toolbox for self-sufficient teams thumbnail
30:07
almost 3 years ago

External Secrets Operator: the secrets management toolbox for self-sufficient teams

Moritz Johner

Building Reliable Serverless Applications with AWS CDK and Testing thumbnail
25:18
almost 3 years ago

Building Reliable Serverless Applications with AWS CDK and Testing

Raphael Manke

Upcoming sessions on this topic

Open session

Multi-Cloud Isn't a Project. It's a Side Effect.

  • Antonio Mendoza Pérez

    Temporal Technologies

    Staff Developer Success Engineer

  • Gaurav Thadani

    Temporal

    Staff Developer Success Engineer

Open session

We Deleted Our Observability Stack and Rebuilt It with OTEL: 12 Engineers to 4 at 20K+ clusters

  • Yash Sharma

    DigitalOcean

    Developer Advocate

Open session

How We Cut Our API's p99 Latency from Minutes to Under a Second

  • Deepak Agrawal

    Atlassian

    Principal Software Engineer

Open session

Architecting Trusted AI: Coupling Multi-Agent Systems with dbt Semantic Store for Zero-Hallucination

  • Pushkar Mishra

    J.P. Morgan

    Senior Vice President

Open session

From Prompt Engineering to Harness Engineering: Building Observable and Governed GenAI Systems

  • Lakshmi Devi Prakash

    JPMorgan Chase

    VP, Applied AI/ML Lead

Open session

Shipping MCP to Real Users: Scaling, Auth, and the PII Leak You Didn't See Coming

  • Hadar Geva

    Myop

    CTO & Co-founder

Related videos

From event streaming to event sourcing 101 thumbnail
27:33
LIVE • almost 6 years ago

From event streaming to event sourcing 101

Gerard Klijs

Functions Triggers using Azure Event Grids in Azure Blob Storage thumbnail
47:38
LIVE • about 6 years ago

Functions Triggers using Azure Event Grids in Azure Blob Storage

Menaka Baskerpillai

CQRS and Event Sourcing without the pixie dust thumbnail
43:27
World Congress 2021 • over 5 years ago

CQRS and Event Sourcing without the pixie dust

Allard Buijze

Autonomous microservices with event-driven architecture thumbnail
24:25
World Congress 2024 • about 2 years ago

Autonomous microservices with event-driven architecture

Florian Lenz

Developer Tools for Microsoft Azure thumbnail
25:41
World Congress 2022 • over 4 years ago

Developer Tools for Microsoft Azure

Radu Vunvulea

Kafka Streams Microservices thumbnail
45:48
World Congress 2021 • over 5 years ago

Kafka Streams Microservices

Denis Washington, Olli Salonen

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.