WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
World Congress 2022 • Jun 15, 2022

A Data Mesh needs Open Metadata

Ferd Scheepers

Decentralized data meshes fail without standardized interoperability. Discover how the open-source metadata standard Egeria automates end-to-end governance and eliminates integration bottlenecks across multi-cloud environments.

Pause
Mute Enter Fullscreen
#1 about 2 min

Embracing open source engineering in a digital bank

Building internal engineering talent to actively contribute to open source software establishes technical leadership.

#2 about 3 min

Standardizing data consumption with a common language

Defining shared business terms through a canonical format simplifies data movement between producers and consumers.

#3 about 2 min

Challenges of manual data mapping and localization

Moving and transforming data across global private and public clouds remains a highly manual logistical hurdle.

#4 about 3 min

Applying flower auction logistics to data metadata

Using metadata as a physical label enables highly automated transportation and logistics for moving diverse items.

#5 about 3 min

Bundling data and metadata for seamless integration

Shipping technical descriptions directly alongside assets eliminates friction during platform exchanges.

#6 about 2 min

Introducing data mesh and localized autonomy

Breaking down centralized dependencies empowers local groups to construct autonomous data products while maintaining global governance.

#7 about 3 min

Navigating the lack of mature data mesh tooling

Implementing localized data autonomy currently requires massive engineering effort to wire together disparate vendor products.

#8 about 2 min

Building the open source fabric data mesh product

Collaborating across organizations to build automated policies and data movement guardrails accelerates data mesh adoption.

#9 about 2 min

Bridging the semantic gap with interoperable metadata

Connecting different platforms requires reliable APIs and formats that preserve context and data quality.

#10 about 3 min

Creating standard APIs via the Egeria open metadata project

Two layers of integration and consumption APIs allow disparate catalogs and repositories to sync structural definitions seamlessly.

#11 about 3 min

Applying the Egeria metadata mesh for federated catalogs

Connecting multiple vendor setups into a federated cohort enables single-pane visibility across independent data environments.

#12 about 4 min

Fostering open source contributions in corporate engineering teams

Allowing engineers to prioritize community-driven open source features over traditional internal business requests fosters innovation.

#13 about 2 min

Enabling cross-platform metadata search and discovery

Indexing business terms, assets, and streaming topics allows technical teams to instantly locate enterprise-wide definitions.

#14 about 2 min

Mapping end-to-end data lineage for regulatory compliance

Rendering reality-based flow graphs proves compliance to auditors without relying on outdated manual documentation.

#15 about 3 min

Advancing industry standards by open sourcing core capabilities

Sharing intellectual property publicly encourages vendor adoption and prevents proprietary lock-in for critical infrastructure.

#16 about 3 min

Shifting culture toward monetizing data as a product

Treating data pipelines as primary revenue drivers incentivizes upstream teams to claim ownership and ensure quality.

#17 about 2 min

Incentivizing domains to produce rich data descriptions

Applying regulatory mandates forces baseline documentation, but rewarding domains for dataset creation drives sustainable metadata quality.

#18 about 2 min

Comparing Egeria to alternative open metadata solutions

A richer core type system provides deeper technical integration capabilities compared to visually appealing but shallow alternatives.

Matching moments

1:50 min

The future of data engineering and AI mesh

Sandhya Menon Sandhya Menon · World Congress 2026 Europe

3:11 min

Decentralizing data bottlenecks with data mesh principles

Matthias Niehoff Matthias Niehoff · World Congress 2024

2:25 min

Adopting a decentralized data mesh architecture model

Sandhya Menon Sandhya Menon · World Congress 2026 Europe

2:18 min

Core principles of decentralized data mesh architecture

Olga Woschitz Olga Woschitz +1 · Europe 2026 Virtual

1:38 min

Understanding data mesh as an organizational design shift

Mario Meir-Huber · LIVE

2:50 min

Adopting data mesh ownership and aggregated data models

Kateřina Ščavnická Kateřina Ščavnická · World Congress 2025

More from World Congress 2022

What the heck do "declarative" and "reactive" actually mean? thumbnail
30:40
about 4 years ago

What the heck do "declarative" and "reactive" actually mean?

André Kovac

The Design and Evolution of C++ thumbnail
1:01:15
over 4 years ago

The Design and Evolution of C++

Bjarne Stroustrup

But, you're not Facebook thumbnail
31:12
over 4 years ago

But, you're not Facebook

Kristijan Ristovski

Communicate efficiently with Software Architecture Diagrams thumbnail
28:11
over 4 years ago

Communicate efficiently with Software Architecture Diagrams

Simon Lasselsberger

Get Ready for Jakarta EE 10! thumbnail
42:53
over 4 years ago

Get Ready for Jakarta EE 10!

Ivar Grimstad

Keep your code refactorable thumbnail
26:46
over 4 years ago

Keep your code refactorable

Gerrit Stapper

Related videos

The Data Mesh as the end of the Datalake as we know it thumbnail
37:21
LIVE • over 5 years ago

The Data Mesh as the end of the Datalake as we know it

Mario Meir-Huber

From Data Mesh to AI Mesh: Integrating Distributed Intelligence on Decentralized Data Architectures thumbnail
45:31
Europe 2026 Virtual • 3 months ago

From Data Mesh to AI Mesh: Integrating Distributed Intelligence on Decentralized Data Architectures

Olga Woschitz, Thomas Görz

From Messy Queries to Scalable Systems - How Data Engineering actually works thumbnail
31:15
World Congress 2026 Europe • 3 months ago

From Messy Queries to Scalable Systems - How Data Engineering actually works

Sandhya Menon

Modern Data Architectures need Software Engineering thumbnail
29:25
World Congress 2024 • about 2 years ago

Modern Data Architectures need Software Engineering

Matthias Niehoff

Bringing Clarity to Event Streams: Enabling Analytics and AI Through Rich Metadata thumbnail
32:12
World Congress 2025 • about 1 year ago

Bringing Clarity to Event Streams: Enabling Analytics and AI Through Rich Metadata

Clemens Vasters

Data: The Deciding Factor in AI Success thumbnail
28:53
World Congress 2026 Europe • 3 months ago

Data: The Deciding Factor in AI Success

Damandeep Kochhar, Jörg Tewes, Siddhika Nevrekar, Ed Huang, Laura Moritz

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.