WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
Back

Senior Data Engineer: Aws, Spark & Data Lake

Jobtailor
Alicante (Alacant), Spain
about 1 month ago
Apply on www.buscojobs.com.es
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Job source
www.buscojobs.com.es

Tech stack

Amazon Web Services Data Architecture Python (Programming Language) SQL Databases Apache Spark Data Lakes Apache Kafka

Job description

Jobtailor busca un/a Ingeniero/a de datos Senior para evolucionar y mantener su Data Lake en la nube, asegurando rendimiento y escalabilidad.Trabajará con pipelines batch y streaming en entornos AWS, diseñando soluciones robustas y eficientes.El candidato ideal tiene experiencia en Spark, Python, SQL y Kafka, conocimiento de Iceberg o Delta Lake, y capacidad para resolver incidencias, colaborar en arquitectura de datos y comunicar de forma clara en entornos técnicos.#J-*****-Ljbffr

Requirements

Trabajará con pipelines batch y streaming en entornos AWS, diseñando soluciones robustas y eficientes.El candidato ideal tiene experiencia en Spark, Python, SQL y Kafka, conocimiento de Iceberg o Delta Lake, y capacidad para resolver incidencias, colaborar en arquitectura de datos y comunicar de forma clara en entornos técnicos.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.buscojobs.com.es
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

Moments

Explore playlists

2:34 min

Capabilities of the Apache Spark processing engine

Ayon Roy · LIVE

3:14 min

Structuring career paths and localized data architectures

Ulrich Wurstbauer +1 · LIVE

3:24 min

The governance failures of centralized data lakes

Mario Meir-Huber · LIVE

1:37 min

Introduction to Apache Kafka benchmarking and performance analysis

Kirill Kulikov · LIVE

6:24 min

Distributed data lakes and containerized computing clusters

Ulrich Wurstbauer +1 · LIVE

2:04 min

Comparing offline data analytics with online stream processing

Artem Volk Artem Volk +1 · World Congress 2024

Videos

See all
Empowering Retail Through Applied Machine Learning thumbnail
22:41
World Congress 2024 • about 2 years ago

Empowering Retail Through Applied Machine Learning

Christoph Fassbach, Daniel Rohr

PySpark - Combining Machine Learning & Big Data thumbnail
43:26
LIVE • almost 6 years ago

PySpark - Combining Machine Learning & Big Data

Ayon Roy

Alibaba Big Data and Machine Learning Technology thumbnail
43:57
LIVE • almost 6 years ago

Alibaba Big Data and Machine Learning Technology

Qiyang Duan

How to Benchmark Your Apache Kafka thumbnail
35:27
LIVE • almost 6 years ago

How to Benchmark Your Apache Kafka

Kirill Kulikov

Building the platform for providing ML predictions based on real-time player activity thumbnail
30:57
World Congress 2024 • about 2 years ago

Building the platform for providing ML predictions based on real-time player activity

Artem Volk, Fabian Zillgens

Let's Get Started With Apache Kafka® for Python Developers thumbnail
38:50
LIVE • over 3 years ago

Let's Get Started With Apache Kafka® for Python Developers

Lucia Cerchie

Related articles

See all