WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
Back

Dataops Engineer: Spark, Databricks & Ci/Cd Pipelines

agap2
Madrid, Spain
6 days ago
Apply on www.buscojobs.com.es
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Job source
www.buscojobs.com.es

Tech stack

Continuous Integration Python (Programming Language) DataOps SQL Databases Apache Spark Databricks

Job description

Agap2 Spain busca un perfil de Data Support & DataOps Engineer con experiencia en soporte de plataformas de datos, resolución de incidencias y mantenimiento de procesos de Data Engineering en entornos distribuidos.Participarás en la resolución de incidencias, optimización de pipelines y soporte operativo de la plataforma.Se requiere dominio de Python y SQL, experiencia con Databricks y Apache Spark, y conocimiento de herramientas CI/CD.#J-*****-Ljbffr

Requirements

Se requiere dominio de Python y SQL, experiencia con Databricks y Apache Spark, y conocimiento de herramientas CI/CD.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.buscojobs.com.es
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

Moments

Explore playlists

2:34 min

Capabilities of the Apache Spark processing engine

Ayon Roy · LIVE

2:05 min

Enhancing Databricks tooling for software engineering workflows

Alan Mazankiewicz · LIVE

5:14 min

Executing Databricks jobs with built-in Airflow operators

Alan Mazankiewicz · LIVE

2:00 min

Separating dataset creation from low-level software implementation steps

Jan Zawadzki · World Congress 2022

2:38 min

Overview of Databricks and interactive data processing

Alan Mazankiewicz · LIVE

8:27 min

Building generic custom operators for Databricks APIs

Alan Mazankiewicz · LIVE

Videos

See all
Fully Orchestrating Databricks from Airflow thumbnail
39:14
LIVE • almost 5 years ago

Fully Orchestrating Databricks from Airflow

Alan Mazankiewicz

PySpark - Combining Machine Learning & Big Data thumbnail
43:26
LIVE • almost 6 years ago

PySpark - Combining Machine Learning & Big Data

Ayon Roy

Implementing continuous delivery in a data processing pipeline thumbnail
34:00
LIVE • almost 6 years ago

Implementing continuous delivery in a data processing pipeline

Álvaro Martín Lozano

Enjoying SQL data pipelines with dbt thumbnail
26:53
World Congress 2023 • almost 3 years ago

Enjoying SQL data pipelines with dbt

Matthias Niehoff

Let's Get Aggregated: Custom UDAFs in Spark thumbnail
19:58
World Congress 2025 • about 1 year ago

Let's Get Aggregated: Custom UDAFs in Spark

Nikolai Nikolaev

Cutting LLM Costs Without Cutting Quality: How to Beat Proprietary LLMs with Fine-Tuned Open Source thumbnail
29:50
World Congress 2026 Europe • 3 months ago

Cutting LLM Costs Without Cutting Quality: How to Beat Proprietary LLMs with Fine-Tuned Open Source

Viktoria Semaan

Related articles

See all