World Congress 2024 • Aug 20, 2024 • Session details

Modern Data Architectures need Software Engineering

Matthias Niehoff

Centralized data teams consistently emerge as workflow bottlenecks. Scaling modern architecture requires treating data as a product using Data Mesh, strict CI/CD contracts, and software engineering practices.

Starting at 8:36 · Watch from the beginning

Modern Data Architectures need Software Engineering thumbnail

Checking access…

Playback and chapters load privately for Free videos.

Matching moments

56 sec

Introduction to analytical data formats for software developers

Matthias Niehoff

Matthias Niehoff · World Congress 2026 Europe

1:19 min

The true role and evolution of data engineering

Sandhya Menon

Sandhya Menon · World Congress 2026 Europe

1:50 min

Introduction to the speaker and data science background

Bas Geerdink · LIVE

2:57 min

Core technical practices for robust data engineering

Sandhya Menon

Sandhya Menon · World Congress 2026 Europe

3:36 min

Analyzing how tech leaders deploy agile automation

Christopher May

Christopher May · Europe 2026 Virtual

2:15 min

Empowering domain teams with an open data platform

Sandhya Menon

Sandhya Menon · World Congress 2026 Europe

More from World Congress 2024

Beyond the Hype: Real-World AI Strategies Panel thumbnail

Beyond the Hype: Real-World AI Strategies Panel

Mike Butcher +3

Carl Lapierre - Exploring Advanced Patterns in Retrieval-Augmented Generation thumbnail

Carl Lapierre - Exploring Advanced Patterns in Retrieval-Augmented Generation

Carl Lapierre · Osedea

Coding an Immersive Copilot using Unity / .NET and Azure OpenAI! thumbnail

Coding an Immersive Copilot using Unity / .NET and Azure OpenAI!

Zaid Zaim · Neo4j

Building a diverse tech company: The power of Diversity, Equity, Inclusion, and Belonging thumbnail

Building a diverse tech company: The power of Diversity, Equity, Inclusion, and Belonging

Sue Quackenbush · Dynatrace

Livecoding with AI thumbnail

Livecoding with AI

Rainer Stropek · software architects

Dapr in Practice thumbnail

Dapr in Practice

marcklefter · AxonIQ

Upcoming sessions on this topic

Starts in 12 days

Conference India 2026

November 25–26, 2026

Bengaluru, India

Get tickets All 107 sessions

Data Quality Is the Hidden System That Keeps Modern Data Platforms Alive
Rakshika Prasad · Schneider Electric

Thu 26 Nov · Stage 4
A Tale of Two Systems: Design and Reality
Mandeep Singh · Kyndryl

Thu 26 Nov · Stage 3 - powered by GitHub
AI at the Door, Turning ‘Tech Debt Panic’ into ‘Tech Debt Repairs’
Prerit Munjal · Groupon

Thu 26 Nov · Mainstage

Related videos

From Messy Queries to Scalable Systems - How Data Engineering actually works thumbnail

From Messy Queries to Scalable Systems - How Data Engineering actually works

Sandhya Menon · E.ON Energy Deutschland

World Congress Europe · 2026

The Data Mesh as the end of the Datalake as we know it thumbnail

The Data Mesh as the end of the Datalake as we know it

Mario Meir-Huber

LIVE · May 2021

Enjoying SQL data pipelines with dbt thumbnail

Enjoying SQL data pipelines with dbt

Matthias Niehoff · codecentric AG

World Congress · 2023

Data Science on Software Data thumbnail

Data Science on Software Data

Markus Harrer · innoQ

World Congress · 2021

Building high performance and scalable architectures for enterprises thumbnail

Building high performance and scalable architectures for enterprises

Luka Samaržija +1

LIVE · Jun 2020

Parquet, Delta, Iceberg & Ducklake - An introduction for developers thumbnail

Parquet, Delta, Iceberg & Ducklake - An introduction for developers

Matthias Niehoff · codecentric

World Congress Europe · 2026

Related articles

AA

Ali Alp

Why Event-Driven Architecture Isn’t About Speed (and When You Actually Need It)

Why Event-Driven Architecture Isn’t About Speed—And When You Actually Need It We’ve all seen it happen. An engineering team wants to feel like they belong in the “cool kids” club, so they grab Apac...

4 months ago

A developer workstation showing a code editor on one monitor, and a diagram on another

BB

Benedikt Bischof

Making Data Warehouses Fast: A Developer’s Story

Welcome to this issue of the WeAreDevelopers Live Talk series. This article recaps an interesting talk by Adnan Rahic who teaches the audience how to make data warehouses.About the Speaker: Adnan i...

over 4 years ago

Making Data Warehouses Fast: A Developer’s Story

AB

Andre Braun, GitLab

Now is the time for industrialized software development

Now is the time for industrialized software development Recently, I received a letter from my car’s manufacturer alerting me to a recall. They had discovered a defective part and wanted to replace ...

over 1 year ago

A person developint HTML on a laptop with the sun shining on it.

BB

Benedikt Bischof

MLops – Deploying, Maintaining And Evolving Machine Learning Models in Production

Welcome to this issue of the WeAreDevelopers Live Talk series. This article recaps an interesting talk by Bas Geerdink who gave advice on MLOps.‍About the speaker:‍Bas is a programmer, scientist, a...

about 4 years ago

MLops – Deploying, Maintaining And Evolving Machine Learning Models in Production

From learning to earning

Jobs that call for the skills explored in this talk.

Senior Data & AI Architect

reeeliance IM GmbH

Berlin, Germany

Expert Hybrid · 3 days on-site · Remote Python Microsoft SQL Server Cloud (AWS/Google/Azure)

10 days ago •

Director of Engineering - Data Platform SDM5

Bengaluru, India

Expert Hybrid · 3 days on-site ETL Spark Java EE

10 days ago •

Software Development Engineer 5

Bengaluru, India

Expert Hybrid · 3 days on-site Java Python Spring Boot

10 days ago •

Senior Software Engineer - Semantic Data Lake (Open)SDE3

Bengaluru, India

Expert Hybrid · 4 days on-site Scala Python Terraform

about 2 months ago •

Cloud Data Engineer (all genders)

Hamburg, Germany

Experienced Hybrid · 3 days on-site Python DevOps Cloud (AWS/Google/Azure)

10 days ago •

Software Development Engineer 4 - Database Engineer

Bengaluru, India

Expert Hybrid · 3 days on-site ETL T-SQL Microsoft SQL Server