Apache Spark for Large-Scale Data Engineering and Analytics

Talks on building ETL pipelines, using Spark SQL, and implementing real-time processing with Structured Streaming. Learn performance tuning and best practices for distributed data workloads.

Matching Videos

Empowering Retail Through Applied Machine Learning
22:41

Empowering Retail Through Applied Machine Learning

Christoph Fassbach & Daniel Rohr

PySpark - Combining Machine Learning & Big Data
43:26

PySpark - Combining Machine Learning & Big Data

Ayon Roy

How Gatsby Cloud's real-time streaming architecture drives <5 second builds
42:10

How Gatsby Cloud's real-time streaming architecture drives <5 second builds

Kyle Mathews

Let's Get Aggregated: Custom UDAFs in Spark
19:58

Let's Get Aggregated: Custom UDAFs in Spark

Nikolai Nikolaev

Fully Orchestrating Databricks from Airflow
39:14

Fully Orchestrating Databricks from Airflow

Alan Mazankiewicz

Building your way to a serverless powered IOT Buzzwire game
1:11:23

Building your way to a serverless powered IOT Buzzwire game

DeveloperSteve

Building the platform for providing ML predictions based on real-time player activity
30:57

Building the platform for providing ML predictions based on real-time player activity

Artem Volk & Fabian Zillgens

Why and when should we consider Stream Processing frameworks in our solutions
30:51

Why and when should we consider Stream Processing frameworks in our solutions

Soroosh Khodami

Innovating Developer Tools with AI: Insights from GitHub Next
42:38

Innovating Developer Tools with AI: Insights from GitHub Next

Krzystof Czieslak

Convert batch code into streaming with Python
46:43

Convert batch code into streaming with Python

Bobur Umurzokov

Implementing continuous delivery in a data processing pipeline
34:00

Implementing continuous delivery in a data processing pipeline

Álvaro Martín Lozano

Let's Get Started With Apache Kafka® for Python Developers
38:50

Let's Get Started With Apache Kafka® for Python Developers

Lucia Cerchie

How Sparking Developer Joy Unlocks Developer Productivity
31:59

How Sparking Developer Joy Unlocks Developer Productivity

Anu Bharadwaj

Next Level Enterprise Architecture: Modular, Flexible, Scalable, Multichannel and AI-Ready?
21:19

Next Level Enterprise Architecture: Modular, Flexible, Scalable, Multichannel and AI-Ready?

Maik Wietheger & Jan-Christoph Schlieker

Enterprise-Cloud-Native - Fast-Paced Development & Deployment in a Highly Secure Banking Environment
21:04

Enterprise-Cloud-Native - Fast-Paced Development & Deployment in a Highly Secure Banking Environment

Jan-Christoph Schlieker & Jan Schmidt

IoT: The road to sustainability
57:23

IoT: The road to sustainability

Philipp-Alexander Blum

The power of the community
30:38

The power of the community

Anna Leushchenko

The Competitive Advantage of Curious Organizations
36:33

The Competitive Advantage of Curious Organizations

Rudi Bauer & Uta Schulz

Fake or News: Coding on a Phone, Emotional Support Toasters, ChatGPT Weddings and more - Anselm Hannemann
04:55

Fake or News: Coding on a Phone, Emotional Support Toasters, ChatGPT Weddings and more - Anselm Hannemann

Chris Heilmann & Daniel Cranney

Devs vs. Marketers, COBOL and Copilot, Make Live Coding Easy and more - The Best of LIVE 2025 - Part 3
1:01:48

Devs vs. Marketers, COBOL and Copilot, Make Live Coding Easy and more - The Best of LIVE 2025 - Part 3

Chris Heilmann, Daniel Cranney, Raphael De Lio, Tim Cadenbach, Julie Kordick, Jan Moser, Elio Struyf, Johanna Pirker, Marc Duiker & Raymond Camden

Outsmarting the System: What Game Cheaters Can Teach Us About Cyber Security
17:31

Outsmarting the System: What Game Cheaters Can Teach Us About Cyber Security

John Romero

WeAreDevelopers LIVE - 50 years Microsoft, Web Readiness Report, The German Web Community and more
1:04:50

WeAreDevelopers LIVE - 50 years Microsoft, Web Readiness Report, The German Web Community and more

Chris Heilmann & Daniel Cranney & Christian Schaefer

WeAreDevelopers LIVE - the weekly developer show with Chris Heilmann and Daniel Cranney
1:12:04

WeAreDevelopers LIVE - the weekly developer show with Chris Heilmann and Daniel Cranney

Exploring the Future of Web AI with Google
33:51

Exploring the Future of Web AI with Google

Thomas Steiner

Dev Digest End of Year Recap
59:21

Dev Digest End of Year Recap

Daniel Cranney & Chris Heilmann

What AI Can, Can’t, and Shouldn’t do for Games
23:12

What AI Can, Can’t, and Shouldn’t do for Games

John Romero

Coffee with Developers - CODE100 Manchester challenger Gbenga Oladipupo
06:08

Coffee with Developers - CODE100 Manchester challenger Gbenga Oladipupo

Gbenga Oladipupo

Live doom II deathmatch with John Romero
1:10:16

Live doom II deathmatch with John Romero

John Romero

Opening Keynote by Sir Tim Berners-Lee
36:29

Opening Keynote by Sir Tim Berners-Lee

Tim Berners-Lee

Web development: where are we, and where are we going?
32:56

Web development: where are we, and where are we going?

Laurie Voss

Organizational Change Through The Power Of Why - DevSecOps Enablement
26:50

Organizational Change Through The Power Of Why - DevSecOps Enablement

Nazneen Rupawalla

The user in the eye of the Cargo1492 storm
47:10

The user in the eye of the Cargo1492 storm

Martin Nader

Why LIT is Fire
31:56

Why LIT is Fire

Lucien Immink

AI is dead, long live AK
22:08

AI is dead, long live AK

Zachary Powell

Successful talent development: A joint journey of executives and talents
18:22

Successful talent development: A joint journey of executives and talents

Julia Schroeder, Dennis Schmidt, Stefan Menschner & Tabitha Kleine

Event Messaging and Streaming with Apache Pulsar
57:19

Event Messaging and Streaming with Apache Pulsar

Mary Grygleski