WeAreDevelopers LIVE • May 26, 2021

The Data Mesh as the end of the Datalake as we know it

Mario Meir-Huber

Centralized data lakes have failed modern enterprises. Discover how the data mesh embraces decentralized architecture to eliminate bottlenecks and empower domain experts.

Pause

Mute

Enter Fullscreen

#1 about 8 min

Data challenges in large enterprise environments

Distributed ownership and legacy systems create data silos that hinder technical innovation in large corporations.

#2 about 2 min

The limitations of early centralized data warehouses

High storage costs and rigid formats limited the long-term success of early centralized data warehouses.

#3 about 4 min

The governance failures of centralized data lakes

Centralizing information into Hadoop-based data lakes often resulted in poor data governance and technical overhead.

#4 about 2 min

Understanding data mesh as an organizational design shift

Treating data management as an organizational shift rather than a technical deployment prevents repetitive decentralization issues.

#5 about 6 min

Shifting focus from monolithic pipelines to business domains

Shifting focus away from complex ETL pipelines and monoliths accelerates delivery for actual business problems.

#6 about 6 min

Applying distributed domain-driven architecture to enterprise data

Empowering business domains with decentralized data ownership mirrors agile microservices architectures and removes IT bottlenecks.

#7 about 4 min

Adopting self-serve managed platforms for data infrastructure

Using managed cloud platforms prevents infrastructure reinventing and allows teams to focus entirely on data workloads.

#8 about 9 min

Treating enterprise data sets as internal products

Defining data as a discoverable and trustworthy internal product ensures quality access for cross-functional teams.

Matching moments

3:11 min

Decentralizing data bottlenecks with data mesh principles

Matthias Niehoff

Matthias Niehoff · WWC 2024

2:25 min

Adopting a decentralized data mesh architecture model

Sandhya Menon

Sandhya Menon · WWC Europe 2026

2:50 min

Adopting data mesh ownership and aggregated data models

Kateřina Ščavnická

Kateřina Ščavnická · WWC 2025

1:50 min

The future of data engineering and AI mesh

Sandhya Menon

Sandhya Menon · WWC Europe 2026

1:49 min

Introducing data mesh and localized autonomy

Ferd Scheepers · WWC 2022

4:32 min

Evolution of centralized data architectures and open table formats

Matthias Niehoff

Matthias Niehoff · WWC 2024

More from WeAreDevelopers LIVE

Aliens in Quarantine, Python Deprecates Loops, and AI Buys Old Books - Zbyszek Tenerowicz thumbnail

Aliens in Quarantine, Python Deprecates Loops, and AI Buys Old Books - Zbyszek Tenerowicz

Chris Heilmann, Daniel Cranney

WeAreDevelopers LIVE - Node and Package Security thumbnail

WeAreDevelopers LIVE - Node and Package Security

Chris Heilmann, Daniel Cranney, Zbyszek Tenerowicz

WeAreDevelopers LIVE - Streaming HTML thumbnail

WeAreDevelopers LIVE - Streaming HTML

Chris Heilmann, Daniel Cranney, Jad Joubran

WeAreDevelopers LIVE - CODE100 at WeAreDevelopers Europe thumbnail

WeAreDevelopers LIVE - CODE100 at WeAreDevelopers Europe

Chris Heilmann, Daniel Cranney, Justin Halsall, Werner Jeschko, Nicole Jeschko, Mirco Tomić

WeAreDevelopers LIVE - Web Performance in an AI World thumbnail

WeAreDevelopers LIVE - Web Performance in an AI World

Chris Heilmann, Daniel Cranney

FIFA Hack, Midjourney Does Ultrasounds, and Trampoline Traffic Lights - Nicole Jeschko and Werner Jeschko thumbnail

about 2 months ago

FIFA Hack, Midjourney Does Ultrasounds, and Trampoline Traffic Lights - Nicole Jeschko and Werner Jeschko

Chris Heilmann, Daniel Cranney

Upcoming sessions on this topic

World Congress 2026 North America

From Guesswork to Governance: Data Contracts Bring API Discipline to Apache Kafka

Sandon Jacobs

Senior Developer Advocate at IBM

Sandon Jacobs

World Congress 2026 North America

You Can’t Re-Run Sunlight: Designing ML Data Architectures for Physical AI

An Phan

Senior Data Infrastructure Engineer @ Hippo Harvest

An Phan

World Congress 2026 North America

Databases in the Agent Era

Monica Sarbu

Founder and CEO of xata.io

Monica Sarbu

World Congress 2026 North America

Fault Tolerance and Consistency at Scale: Harnessing the Power of Distributed SQL Databases

Wei Hu

Senior Vice President of Research and Development

Wei Hu

World Congress 2026 North America

It’s Alive! Taming the MLOps Franken-Stack: Write, Run, and Serve with Michelangelo

Eric Wang, Paul Zimmerman

Eric Wang

Paul Zimmerman

World Congress 2026 North America

Making Science Larger, not just Faster

Yuval Dvir

Commercial Executive, SandboxAQ

Yuval Dvir

Related videos

Modern Data Architectures need Software Engineering thumbnail

WWC 2024 • almost 2 years ago

Modern Data Architectures need Software Engineering

Matthias Niehoff

A Data Mesh needs Open Metadata thumbnail

WWC 2022 • about 4 years ago

A Data Mesh needs Open Metadata

Ferd Scheepers

From Messy Queries to Scalable Systems - How Data Engineering actually works thumbnail

WWC Europe 2026 • about 1 month ago

From Messy Queries to Scalable Systems - How Data Engineering actually works

Sandhya Menon

Data Governance in the Era of AI thumbnail

WWC 2025 • 12 months ago

Data Governance in the Era of AI

Kateřina Ščavnická

Data Fabric in Action - How to enhance a Stock Trading App with ML and Data Virtualization thumbnail

LIVE • almost 5 years ago

Data Fabric in Action - How to enhance a Stock Trading App with ML and Data Virtualization

Andreas Christian

Blueprints for Success: Steering a Global Data & AI Architecture thumbnail

WWC 2025 • 12 months ago

Blueprints for Success: Steering a Global Data & AI Architecture

Dominik Schneider

Related articles

BB

Benedikt Bischof

Making Data Warehouses Fast: A Developer’s Story

Welcome to this issue of the WeAreDevelopers Live Talk series. This article recaps an interesting talk by Adnan Rahic who teaches the audience how to make data warehouses.About the Speaker: Adnan i...

about 4 years ago

Making Data Warehouses Fast: A Developer’s Story

AA

Ali Alp

Why Event-Driven Architecture Isn’t About Speed (and When You Actually Need It)

Why Event-Driven Architecture Isn’t About Speed—And When You Actually Need It We’ve all seen it happen. An engineering team wants to feel like they belong in the “cool kids” club, so they grab Apac...

11 days ago

A developer workstation showing a code editor on one monitor, and a diagram on another

BB

Benedikt Bischof

MLops – Deploying, Maintaining And Evolving Machine Learning Models in Production

Welcome to this issue of the WeAreDevelopers Live Talk series. This article recaps an interesting talk by Bas Geerdink who gave advice on MLOps.‍About the speaker:‍Bas is a programmer, scientist, a...

almost 4 years ago

MLops – Deploying, Maintaining And Evolving Machine Learning Models in Production

DC

Daniel Cranney

What does the history of data storage tell us about the future?

In the rapidly advancing world of computing, data storage stands as a cornerstone that has evolved profoundly over the decades, adapting to meet growing demands for durability, scalability, and acc...

almost 2 years ago

What does the history of data storage tell us about the future?

From learning to earning

Jobs that call for the skills explored in this talk.

about 1 month ago

MDM Data Specialist (L2)

Indianapolis, IN, United States

Experienced Remote BigQuery Snowflake Core Data

Lead Software Engineer - Data Engineering

Barcelona, Spain

NoSQL DevOps Docker

Data Scientist

Berlin, Germany

€80k–200k Airflow Terraform Kubernetes

29 days ago • Verified

Cloud Data Engineer (all genders)

Hamburg, Germany

Experienced Remote Python DevOps Cloud (AWS/Google/Azure)

about 1 month ago

Senior Data Engineer

Düsseldorf, Germany

Expert Git Snowflake Code Review

about 2 months ago

Staff Business Intelligence Engineer

Indianapolis, IN, United States

Experienced Remote Twilio Snowflake Data Analysis