ETL: Building and Optimizing Data Pipelines

Explore talks on designing scalable ETL pipelines. Topics include data quality, performance tuning, batch vs. stream processing, and using modern tools like Airflow, Spark, and Kafka.

Matching Videos

Alibaba Big Data and Machine Learning Technology
43:57

Alibaba Big Data and Machine Learning Technology

Dr. Qiyang Duan

Introduction to Azure Machine Learning
54:27

Introduction to Azure Machine Learning

Jose Luis Latorre Millas

Modern Data Architectures need Software Engineering
29:25

Modern Data Architectures need Software Engineering

Matthias Niehoff

Our GitOps approach for deploying an Identity Provider and an API Gateway in a SaaS company
17:31

Our GitOps approach for deploying an Identity Provider and an API Gateway in a SaaS company

Axel Barbier

Building AI-Driven Spring Applications With Spring AI
32:14

Building AI-Driven Spring Applications With Spring AI

Timo Salm & Sandra Ahlgrimm

Enjoying SQL data pipelines with dbt
26:53

Enjoying SQL data pipelines with dbt

Matthias Niehoff

Every CEO needs a digital twin to understand the scope of generative AI
30:30

Every CEO needs a digital twin to understand the scope of generative AI

Kai Mueller & Sebastian Luxem

Fully Orchestrating Databricks from Airflow
39:14

Fully Orchestrating Databricks from Airflow

Alan Mazankiewicz

A Data Mesh needs Open Metadata
38:36

A Data Mesh needs Open Metadata

Ferd Scheepers

The Data Mesh as the end of the Datalake as we know it
37:21

The Data Mesh as the end of the Datalake as we know it

Mario Meir-Huber

100 million days in Vienna: A story of APIs & AI in tourism.
43:11

100 million days in Vienna: A story of APIs & AI in tourism.

Thomas Reiter

Concurrency with Go
56:19

Concurrency with Go

Frank Müller

Hands on with OpenTelemetry
53:57

Hands on with OpenTelemetry

Nočnica Mellifera

Telemetry without the 'Tool Tax'
24:30

Telemetry without the 'Tool Tax'

Ben Greenberg

Observability with OpenTelemetry & Elastic
30:29

Observability with OpenTelemetry & Elastic

Iulia Feroli

Why make use of an integration platform in today's software developments and infrastructure?
18:57

Why make use of an integration platform in today's software developments and infrastructure?

Nils Hünerberg

Implementing continuous delivery in a data processing pipeline
34:00

Implementing continuous delivery in a data processing pipeline

Álvaro Martín Lozano

Data Fabric in Action - How to enhance a Stock Trading App with ML and Data Virtualization
45:58

Data Fabric in Action - How to enhance a Stock Trading App with ML and Data Virtualization

Andreas Christian

Data Analytics with Microsoft Fabric: End-to-End Use Case with Data Agents
26:58

Data Analytics with Microsoft Fabric: End-to-End Use Case with Data Agents

Dr. Alexander Wachtel & Hanna Schwab

Bringing Clarity to Event Streams: Enabling Analytics and AI Through Rich Metadata
32:12

Bringing Clarity to Event Streams: Enabling Analytics and AI Through Rich Metadata

Clemens Vasters

Valven Atlas: Engineering Intelligence That Delivers
04:48

Valven Atlas: Engineering Intelligence That Delivers

Serdar Bicer

Transforming Task Management: Integrating Camunda with Scalable Frontend Solutions
27:33

Transforming Task Management: Integrating Camunda with Scalable Frontend Solutions

Kevin Kaiser & Ludwig Wrabel

Empowering Retail Through Applied Machine Learning
22:41

Empowering Retail Through Applied Machine Learning

Christoph Fassbach & Daniel Rohr

All your telemetry data from any source in one place
2:01:25

All your telemetry data from any source in one place

Liam Hurrell

Remote Driving on Plant Grounds with State-of-the-Art Cloud Technologies
48:54

Remote Driving on Plant Grounds with State-of-the-Art Cloud Technologies

Oliver Zimmert

The Evolution of Enterprise Java with Jakarta EE 11 and Beyond
30:16

The Evolution of Enterprise Java with Jakarta EE 11 and Beyond

Ivar Grimstad

Unlocking Value from Data: The Key to Smarter Business Decisions-
28:29

Unlocking Value from Data: The Key to Smarter Business Decisions-

Taqi Jaffri, Kapil Gupta & Farooq Sheikh and Tomislav Tipurić

Enterprise Integration Is Dead! Long Live AI-Driven Integration with Apache Camel
32:24

Enterprise Integration Is Dead! Long Live AI-Driven Integration with Apache Camel

Bruno Meseguer & Markus Eisele

The user in the eye of the Cargo1492 storm
47:10

The user in the eye of the Cargo1492 storm

Martin Nader

Convert batch code into streaming with Python
46:43

Convert batch code into streaming with Python

Bobur Umurzokov

Data Science in Retail
58:21

Data Science in Retail

Julian Joseph

Tips, Techniques, and Common Pitfalls Debugging Kafka
54:29

Tips, Techniques, and Common Pitfalls Debugging Kafka

DeveloperSteve

Dirty Tests And How To Clean Them
54:58

Dirty Tests And How To Clean Them

Gil Zilberfeld

The future of automotive mobility: Upcoming E/E architectures, V2X and its challenges
1:47:33

The future of automotive mobility: Upcoming E/E architectures, V2X and its challenges

Georg Kühberger & Manuel Pascual

Tolgee: Open-Source, In-Context AI Localization That Cuts Dev Effort
03:36

Tolgee: Open-Source, In-Context AI Localization That Cuts Dev Effort

Jan Cizmar

Dev & Test in the Cloud? Deploy your cloud environments with Ansible & Terraform
22:41

Dev & Test in the Cloud? Deploy your cloud environments with Ansible & Terraform

Goetz Rieger