WeAreDevelopers LIVE • Nov 12, 2020

Implementing continuous delivery in a data processing pipeline

Álvaro Martín Lozano

Standard continuous delivery practices fail when your final deliverable is data. How can immutable architecture and functional programming principles make your pipeline rollbacks instantaneous?

Implementing continuous delivery in a data processing pipeline thumbnail

Checking access…

Playback and chapters load privately for Free videos.

Matching moments

3:28 min

Implementing continuous delivery architecture for machine learning

Dubravko Dolic +1 · World Congress 2021

7:56 min

Evolution of software delivery and the devops pipeline

Raz Cohen · LIVE

4:29 min

Automating delivery pipelines and managing infrastructure via code

Megha Kadur · LIVE

6:08 min

Applying software engineering environments and testing to data pipelines

Matthias Niehoff

Matthias Niehoff · World Congress 2024

1:38 min

Evolution from manual deployments to continuous integration

Kevin Dubois

Kevin Dubois · World Congress 2025

2:03 min

Establishing reproducible data science with openness and automation

Markus Harrer

Markus Harrer · World Congress 2021

More from WeAreDevelopers LIVE

Why Your Side Projects Are Worth Sharing thumbnail

Why Your Side Projects Are Worth Sharing

Haimantika Mitra +2

Yesterday

Humans in the Loop: Storytelling in Tech thumbnail

Humans in the Loop: Storytelling in Tech

Pritesh Kiri +2

Last week

WeAreDevelopers LIVE: Your Brain Is Lying to You: Cognitive Biases in Development thumbnail

Your Brain Is Lying to You: Cognitive Biases in Development

2 weeks ago

Like Peas in a Pod - What Happens When People Clone Your App? thumbnail

Like Peas in a Pod - What Happens When People Clone Your App?

Ivan Kutskir +2

3 weeks ago

WeAreDevelopers LIVE - Read more, Prompt Less thumbnail

Read more, Prompt Less

Luise Freese +2

4 weeks ago

WeAreDevelopers LIVE - Tech Education in Two Languages thumbnail

Tech Education in Two Languages

Roxy Rodriguez-Becker +1

Oct 2026

Upcoming sessions on this topic

Starts in 12 days

Conference India 2026

November 25–26, 2026

Bengaluru, India

Get tickets All 107 sessions

Data Quality Is the Hidden System That Keeps Modern Data Platforms Alive
Rakshika Prasad · Schneider Electric

Thu 26 Nov · Stage 4
Ship Happens: Guardrails for AI-Written Code
Anthony Nguyen · LaunchDarkly

Wed 25 Nov · Stage 3 - powered by GitHub
CI. CD. AI. Welcome to Continuous AI
Akash Dwivedi & Ambily Kavumkal Kamalasanan

Thu 26 Nov · Room 6

Related videos

Modern Data Architectures need Software Engineering thumbnail

Modern Data Architectures need Software Engineering

Matthias Niehoff · codecentric AG

World Congress · 2024

Integrating backups into your GitOps Pipeline thumbnail

Integrating backups into your GitOps Pipeline

Florian Trieloff

World Congress · 2023

From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform thumbnail

From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform

Dominik Krichbaum · ING

World Congress Europe · 2026

Charting the Journey to Continuous Deployment with a Value Stream Map thumbnail

Charting the Journey to Continuous Deployment with a Value Stream Map

Josh Armitage

LIVE · May 2021

Plan CI/CD on the Enterprise level! thumbnail

Plan CI/CD on the Enterprise level!

Pawel Piwosz

LIVE · Apr 2023

From Messy Queries to Scalable Systems - How Data Engineering actually works thumbnail

From Messy Queries to Scalable Systems - How Data Engineering actually works

Sandhya Menon · E.ON Energy Deutschland

World Congress Europe · 2026

Related articles

BB

Benedikt Bischof

MLops – Deploying, Maintaining And Evolving Machine Learning Models in Production

Welcome to this issue of the WeAreDevelopers Live Talk series. This article recaps an interesting talk by Bas Geerdink who gave advice on MLOps.‍About the speaker:‍Bas is a programmer, scientist, a...

about 4 years ago

MLops – Deploying, Maintaining And Evolving Machine Learning Models in Production

BB

Benedikt Bischof

MLOps – What’s the deal behind it?

Welcome to this issue of the WeAreDevelopers Live Talk series. This article recaps an interesting talk by Nico Axtmann who introduced us to MLOpsAbout the speaker:Nico Axtmann is a seasoned machine...

about 4 years ago

MLOps – What’s the deal behind it?

BR

Benjamin Ruschin

Navigating the AI Shift

AI has had an undeniable impact on all kinds of aspects of life and work, from how we do everyday tasks, to how software is built, how companies operate, and even how work itself is defined. Despit...

about 1 year ago

A laptop interacting with AI

AB

Andre Braun, GitLab

Now is the time for industrialized software development

Now is the time for industrialized software development Recently, I received a letter from my car’s manufacturer alerting me to a recall. They had discovered a defective part and wanted to replace ...

over 1 year ago

A person developint HTML on a laptop with the sun shining on it.

From learning to earning

Jobs that call for the skills explored in this talk.

Senior Data & AI Architect

reeeliance IM GmbH

Berlin, Germany

Expert Hybrid · 3 days on-site · Remote Python Microsoft SQL Server Cloud (AWS/Google/Azure)

10 days ago •

Senior Software Engineer - Semantic Data Lake (Open)SDE3

Bengaluru, India

Expert Hybrid · 4 days on-site Scala Python Terraform

10 days ago •

Director of Engineering - Data Platform SDM5

Bengaluru, India

Expert Hybrid · 3 days on-site ETL Spark Java EE

about 2 months ago •

Cloud Data Engineer (all genders)

Hamburg, Germany

Experienced Hybrid · 3 days on-site Python DevOps Cloud (AWS/Google/Azure)

10 days ago •

Software Development Engineer 4 - Database Engineer

Bengaluru, India

Expert Hybrid · 3 days on-site ETL T-SQL Microsoft SQL Server

Forward Deployed Data Engineering - Experienced Associate

New York, NY, United States

Experienced $63k–153k Scripting Code Review Api Management