WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
WeAreDevelopers LIVE • Nov 12, 2020

Implementing continuous delivery in a data processing pipeline

Álvaro Martín Lozano

Standard continuous delivery practices fail when your final deliverable is data. How can immutable architecture and functional programming principles make your pipeline rollbacks instantaneous?

Implementing continuous delivery in a data processing pipeline thumbnail

Checking access…

Playback and chapters load privately for Free videos.

Matching moments

3:28 min

Implementing continuous delivery architecture for machine learning

Dubravko Dolic +1 · World Congress 2021

7:56 min

Evolution of software delivery and the devops pipeline

Raz Cohen · LIVE

4:29 min

Automating delivery pipelines and managing infrastructure via code

Megha Kadur · LIVE

6:08 min

Applying software engineering environments and testing to data pipelines

Matthias Niehoff Matthias Niehoff · World Congress 2024

1:38 min

Evolution from manual deployments to continuous integration

Kevin Dubois Kevin Dubois · World Congress 2025

2:03 min

Establishing reproducible data science with openness and automation

Markus Harrer Markus Harrer · World Congress 2021

More from WeAreDevelopers LIVE

Like Peas in a Pod - What Happens When People Clone Your App? thumbnail
1:16:14
4 days ago

Like Peas in a Pod - What Happens When People Clone Your App?

Ivan Kutskir, Christian Heilmann, Daniel Cranney

WeAreDevelopers LIVE - Read more, Prompt Less thumbnail
1:01:30
11 days ago

WeAreDevelopers LIVE - Read more, Prompt Less

Christian Heilmann, Daniel Cranney, Luise Freese

WeAreDevelopers LIVE - Tech Education in Two Languages thumbnail
1:00:18
18 days ago

WeAreDevelopers LIVE - Tech Education in Two Languages

Daniel Cranney, Roxy Rodriguez-Becker

WeAreDevelopers LIVE - Playing in Production thumbnail
1:06:40
25 days ago

WeAreDevelopers LIVE - Playing in Production

Andrew MacLean, Daniel Cranney, Christian Heilmann

WeAreDevelopers LIVE - Is CSS Catching Up to Flash? thumbnail
1:03:33
about 1 month ago

WeAreDevelopers LIVE - Is CSS Catching Up to Flash?

Chris Heilmann, Daniel Cranney, Bramus Van Damme

WeAreDevelopers LIVE - Project Chopin: Make Your Team and Agents Play Along thumbnail
1:21:17
about 2 months ago

WeAreDevelopers LIVE - Project Chopin: Make Your Team and Agents Play Along

Chris Heilmann, Daniel Cranney, Krzysztof Cieślak

Upcoming sessions on this topic

Open session

AI Is the Easy Part: Why Faster Engineers Don't Make Faster Businesses

  • Bharat Sharma

    Booking

    Senior Engineering Manager

Open session

Multi-Cloud Isn't a Project. It's a Side Effect.

  • Antonio Mendoza Pérez

    Temporal Technologies

    Staff Developer Success Engineer

  • Gaurav Thadani

    Temporal

    Staff Developer Success Engineer

Open session

From Prompt Engineering to Harness Engineering: Building Observable and Governed GenAI Systems

  • Lakshmi Devi Prakash

    JPMorgan Chase

    VP, Applied AI/ML Lead

Open session

How We Cut Our API's p99 Latency from Minutes to Under a Second

  • Deepak Agrawal

    Atlassian

    Principal Software Engineer

Open session

We Deleted Our Observability Stack and Rebuilt It with OTEL: 12 Engineers to 4 at 20K+ clusters

  • Yash Sharma

    DigitalOcean

    Developer Advocate

  • Sreeram Venkitesh

    DigitalOcean

    Senior Software Engineer

  • Kapil Gautam

    Digitalocean

    Software Engineer II

Open session

Beyond File Dumps: Context Engineering for Coding Agents

  • Animesh Dutta

    Arm

    Senior Software Engineer

Related videos

Modern Data Architectures need Software Engineering thumbnail
29:25
World Congress 2024 • about 2 years ago

Modern Data Architectures need Software Engineering

Matthias Niehoff

Integrating backups into your GitOps Pipeline thumbnail
25:24
World Congress 2023 • about 3 years ago

Integrating backups into your GitOps Pipeline

Florian Trieloff

From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform thumbnail
22:57
World Congress 2026 Europe • 4 months ago

From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform

Dominik Krichbaum

Charting the Journey to Continuous Deployment with a Value Stream Map thumbnail
30:46
LIVE • over 5 years ago

Charting the Journey to Continuous Deployment with a Value Stream Map

Josh Armitage

Plan CI/CD on the Enterprise level! thumbnail
56:19
LIVE • over 3 years ago

Plan CI/CD on the Enterprise level!

Pawel Piwosz

From Messy Queries to Scalable Systems - How Data Engineering actually works thumbnail
31:15
World Congress 2026 Europe • 4 months ago

From Messy Queries to Scalable Systems - How Data Engineering actually works

Sandhya Menon

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.