WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
World Congress 2024 • Aug 20, 2024 • Session details

Modern Data Architectures need Software Engineering

Matthias Niehoff

Centralized data teams consistently emerge as workflow bottlenecks. Scaling modern architecture requires treating data as a product using Data Mesh, strict CI/CD contracts, and software engineering practices.

Starting at 5:24 · Watch from the beginning

Modern Data Architectures need Software Engineering thumbnail

Checking access…

Playback and chapters load privately for Free videos.

Matching moments

56 sec

Introduction to analytical data formats for software developers

Matthias Niehoff Matthias Niehoff · World Congress 2026 Europe

1:19 min

The true role and evolution of data engineering

Sandhya Menon Sandhya Menon · World Congress 2026 Europe

1:50 min

Introduction to the speaker and data science background

Bas Geerdink · LIVE

2:57 min

Core technical practices for robust data engineering

Sandhya Menon Sandhya Menon · World Congress 2026 Europe

3:36 min

Analyzing how tech leaders deploy agile automation

Christopher May Christopher May · Europe 2026 Virtual

2:15 min

Empowering domain teams with an open data platform

Sandhya Menon Sandhya Menon · World Congress 2026 Europe

More from World Congress 2024

Beyond the Hype: Real-World AI Strategies Panel thumbnail
24:07

Beyond the Hype: Real-World AI Strategies Panel

Mike Butcher +3

Carl Lapierre - Exploring Advanced Patterns in Retrieval-Augmented Generation thumbnail
21:17

Carl Lapierre - Exploring Advanced Patterns in Retrieval-Augmented Generation

Carl Lapierre · Osedea

Coding an Immersive Copilot using Unity / .NET and Azure OpenAI! thumbnail
31:50

Coding an Immersive Copilot using Unity / .NET and Azure OpenAI!

Zaid Zaim · Neo4j

Building a diverse tech company: The power of Diversity, Equity, Inclusion, and Belonging thumbnail
29:43

Building a diverse tech company: The power of Diversity, Equity, Inclusion, and Belonging

Sue Quackenbush · Dynatrace

Livecoding with AI thumbnail
31:39

Livecoding with AI

Rainer Stropek · software architects

Dapr in Practice thumbnail
24:08

Dapr in Practice

marcklefter · AxonIQ

Upcoming sessions on this topic

Open session

Data Quality Is the Hidden System That Keeps Modern Data Platforms Alive

  • Rakshika Prasad

    Schneider Electric

    Data Engineer

Open session

A Tale of Two Systems: Design and Reality

  • Mandeep Singh

    Kyndryl

    Lead Software Engineer

Open session

AI at the Door, Turning ‘Tech Debt Panic’ into ‘Tech Debt Repairs’

  • Prerit Munjal

    Groupon

    Senior Technical Product Manager

Open session

Engineering AI Strategy: Beyond the Hype

  • Omkar Srivastava

    ADSK

    Engineering Leader

Open session

Migrating 47 TB in Under 48 Hours: Lessons from the Front Lines

  • Sandeep S. Nair

    Microsoft

    Principal Program Manager

Open session

Architecting Trusted AI: Coupling Multi-Agent Systems with dbt Semantic Store for Zero-Hallucination

  • Pushkar Mishra

    J.P. Morgan

    Senior Vice President

Related videos

From Messy Queries to Scalable Systems - How Data Engineering actually works thumbnail
31:15

From Messy Queries to Scalable Systems - How Data Engineering actually works

Sandhya Menon · E.ON Energy Deutschland

World Congress Europe · 2026

The Data Mesh as the end of the Datalake as we know it thumbnail
37:21

The Data Mesh as the end of the Datalake as we know it

Mario Meir-Huber

LIVE · May 2021

Enjoying SQL data pipelines with dbt thumbnail
26:53

Enjoying SQL data pipelines with dbt

Matthias Niehoff · codecentric AG

World Congress · 2023

Data Science on Software Data thumbnail
48:10

Data Science on Software Data

Markus Harrer · innoQ

World Congress · 2021

Building high performance and scalable architectures for enterprises thumbnail
58:23

Building high performance and scalable architectures for enterprises

Luka Samaržija +1

LIVE · Jun 2020

Parquet, Delta, Iceberg & Ducklake - An introduction for developers thumbnail
28:42

Parquet, Delta, Iceberg & Ducklake - An introduction for developers

Matthias Niehoff · codecentric

World Congress Europe · 2026

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.