WeAreDevelopers LIVE • May 26, 2021

The Data Mesh as the end of the Datalake as we know it

Mario Meir-Huber

Centralized data lakes have failed modern enterprises. Discover how the data mesh embraces decentralized architecture to eliminate bottlenecks and empower domain experts.

Pause

Mute

Enter Fullscreen

#1 about 8 min

Data challenges in large enterprise environments

Distributed ownership and legacy systems create data silos that hinder technical innovation in large corporations.

#2 about 2 min

The limitations of early centralized data warehouses

High storage costs and rigid formats limited the long-term success of early centralized data warehouses.

#3 about 4 min

The governance failures of centralized data lakes

Centralizing information into Hadoop-based data lakes often resulted in poor data governance and technical overhead.

#4 about 2 min

Understanding data mesh as an organizational design shift

Treating data management as an organizational shift rather than a technical deployment prevents repetitive decentralization issues.

#5 about 6 min

Shifting focus from monolithic pipelines to business domains

Shifting focus away from complex ETL pipelines and monoliths accelerates delivery for actual business problems.

#6 about 6 min

Applying distributed domain-driven architecture to enterprise data

Empowering business domains with decentralized data ownership mirrors agile microservices architectures and removes IT bottlenecks.

#7 about 4 min

Adopting self-serve managed platforms for data infrastructure

Using managed cloud platforms prevents infrastructure reinventing and allows teams to focus entirely on data workloads.

#8 about 9 min

Treating enterprise data sets as internal products

Defining data as a discoverable and trustworthy internal product ensures quality access for cross-functional teams.

Matching moments

3:11 min

Decentralizing data bottlenecks with data mesh principles

Matthias Niehoff

Matthias Niehoff · World Congress 2024

2:25 min

Adopting a decentralized data mesh architecture model

Sandhya Menon

Sandhya Menon · World Congress 2026 Europe

2:18 min

Core principles of decentralized data mesh architecture

Olga Woschitz

Olga Woschitz +1 · Europe 2026 Virtual

2:50 min

Adopting data mesh ownership and aggregated data models

Kateřina Ščavnická

Kateřina Ščavnická · World Congress 2025

1:50 min

The future of data engineering and AI mesh

Sandhya Menon

Sandhya Menon · World Congress 2026 Europe

1:49 min

Introducing data mesh and localized autonomy

Ferd Scheepers · World Congress 2022

More from WeAreDevelopers LIVE

WeAreDevelopers LIVE - Is CSS Catching Up to Flash? thumbnail

WeAreDevelopers LIVE - Is CSS Catching Up to Flash?

Chris Heilmann, Daniel Cranney, Bramus Van Damme

WeAreDevelopers LIVE - Project Chopin: Make Your Team and Agents Play Along thumbnail

WeAreDevelopers LIVE - Project Chopin: Make Your Team and Agents Play Along

Chris Heilmann, Daniel Cranney, Krzysztof Cieślak

Fake or News - AI Toothbrushes, Carrier Pigeon Tech & Life on Mars - Krzysztof Cieślak thumbnail

Fake or News - AI Toothbrushes, Carrier Pigeon Tech & Life on Mars - Krzysztof Cieślak

Chris Heilmann, Daniel Cranney

WeAreDevelopers LIVE - Open Source Agent Toolkits thumbnail

WeAreDevelopers LIVE - Open Source Agent Toolkits

Chris Heilmann, Daniel Cranney, Eddie Jaoude

Fake or News - AI Music Detectors, Translating Ancient Languages & Tiny Heads in Teslas - Eddie Jaoude thumbnail

Fake or News - AI Music Detectors, Translating Ancient Languages & Tiny Heads in Teslas - Eddie Jaoude

Chris Heilmann, Daniel Cranney

Fake or News: AI Agents Hire Each Other, Spider-Man Ads in Cars & RAM Thieves - Marc Plogas thumbnail

about 1 month ago

Fake or News: AI Agents Hire Each Other, Spider-Man Ads in Cars & RAM Thieves - Marc Plogas

Chris Heilmann, Daniel Cranney, Marc Plogas

Related videos

Modern Data Architectures need Software Engineering thumbnail

World Congress 2024 • about 2 years ago

Modern Data Architectures need Software Engineering

Matthias Niehoff

A Data Mesh needs Open Metadata thumbnail

World Congress 2022 • over 4 years ago

A Data Mesh needs Open Metadata

Ferd Scheepers

From Data Mesh to AI Mesh: Integrating Distributed Intelligence on Decentralized Data Architectures thumbnail

Europe 2026 Virtual • 3 months ago

From Data Mesh to AI Mesh: Integrating Distributed Intelligence on Decentralized Data Architectures

Olga Woschitz, Thomas Görz

From Messy Queries to Scalable Systems - How Data Engineering actually works thumbnail

World Congress 2026 Europe • 3 months ago

From Messy Queries to Scalable Systems - How Data Engineering actually works

Sandhya Menon

Data Governance in the Era of AI thumbnail

World Congress 2025 • about 1 year ago

Data Governance in the Era of AI

Kateřina Ščavnická

Data Fabric in Action - How to enhance a Stock Trading App with ML and Data Virtualization thumbnail

LIVE • about 5 years ago

Data Fabric in Action - How to enhance a Stock Trading App with ML and Data Virtualization

Andreas Christian

Related articles

BB

Benedikt Bischof

Making Data Warehouses Fast: A Developer’s Story

Welcome to this issue of the WeAreDevelopers Live Talk series. This article recaps an interesting talk by Adnan Rahic who teaches the audience how to make data warehouses.About the Speaker: Adnan i...

about 4 years ago

Making Data Warehouses Fast: A Developer’s Story

AA

Ali Alp

Why Event-Driven Architecture Isn’t About Speed (and When You Actually Need It)

Why Event-Driven Architecture Isn’t About Speed—And When You Actually Need It We’ve all seen it happen. An engineering team wants to feel like they belong in the “cool kids” club, so they grab Apac...

about 2 months ago

A developer workstation showing a code editor on one monitor, and a diagram on another

BB

Benedikt Bischof

MLops – Deploying, Maintaining And Evolving Machine Learning Models in Production

Welcome to this issue of the WeAreDevelopers Live Talk series. This article recaps an interesting talk by Bas Geerdink who gave advice on MLOps.‍About the speaker:‍Bas is a programmer, scientist, a...

about 4 years ago

MLops – Deploying, Maintaining And Evolving Machine Learning Models in Production

DC

Daniel Cranney

What does the history of data storage tell us about the future?

In the rapidly advancing world of computing, data storage stands as a cornerstone that has evolved profoundly over the decades, adapting to meet growing demands for durability, scalability, and acc...

almost 2 years ago

What does the history of data storage tell us about the future?

From learning to earning

Jobs that call for the skills explored in this talk.

about 1 month ago • Verified

Data Governance Lead

Boston, United States

Expert Remote PostgreSQL Data analysis Data Warehouse

MDM Data Specialist (L2)

Indianapolis, IN, United States

Experienced Remote BigQuery Snowflake Core Data

about 2 months ago

Data Strategy-Manager

Rosemont, IL, United States

Expert $99k–232k Big Data Collibra Databricks

Data Governance- Manager

Seattle, WA, United States

Expert $99k–232k Big Data Collibra Databricks

about 2 months ago

Data Governance- Manager

Detroit, MI, United States

Expert $99k–232k Big Data Collibra Databricks

about 2 months ago

Data Governance- Manager

Atlanta, GA, United States

Expert $99k–232k Big Data Collibra Databricks