WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
Back

Data Engineer - Spark

Banco Santander, S.A.
Madrid, Spain
5 days ago
Apply on www.jobleads.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience required
5 years minimum
Compensation
€70,000.0 - €95,000.0
Working hours
Regular working hours
Job source
www.jobleads.com

Tech stack

Amazon Web Services Information Engineering Apache Spark Pyspark Stream Processing Data Pipelines

Job description

Open Digital Services in Madrid seeks a Senior Data Engineer to design and optimize large-scale data pipelines using Spark, primarily with Scala, on AWS cloud. You will build batch and near-real-time data processing solutions, ensuring data quality and governance while collaborating with Data Science, ML and business teams.

Requirements

The role requires 5+ years in data engineering, strong Spark/PySpark skills, and experience in regulated environments.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.jobleads.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

Moments

Explore playlists

2:34 min

Capabilities of the Apache Spark processing engine

Ayon Roy · LIVE

6:08 min

Applying software engineering environments and testing to data pipelines

Matthias Niehoff Matthias Niehoff · World Congress 2024

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

2:04 min

Comparing offline data analytics with online stream processing

Artem Volk Artem Volk +1 · World Congress 2024

2:56 min

Options for database machine learning integration architectures

Akmal Chaudhri Akmal Chaudhri · LIVE

4:18 min

Exploring the Apache Spark layer architecture

Ayon Roy · LIVE

Videos

See all
PySpark - Combining Machine Learning & Big Data thumbnail
43:26
LIVE • almost 6 years ago

PySpark - Combining Machine Learning & Big Data

Ayon Roy

Why and when should we consider Stream Processing frameworks in our solutions thumbnail
30:51
World Congress 2024 • about 2 years ago

Why and when should we consider Stream Processing frameworks in our solutions

Soroosh Khodami

Implementing continuous delivery in a data processing pipeline thumbnail
34:00
LIVE • almost 6 years ago

Implementing continuous delivery in a data processing pipeline

Álvaro Martín Lozano

Data Science in Retail thumbnail
58:21
LIVE • over 3 years ago

Data Science in Retail

Julian Joseph

Empowering Retail Through Applied Machine Learning thumbnail
22:41
World Congress 2024 • about 2 years ago

Empowering Retail Through Applied Machine Learning

Christoph Fassbach, Daniel Rohr

Python-Based Data Streaming Pipelines Within Minutes thumbnail
39:04
LIVE • almost 2 years ago

Python-Based Data Streaming Pipelines Within Minutes

Bobur Umurzokov

Related articles

See all