WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
Back

Databricks Data Engineer

Comunidad de Madrid
Madrid, Spain
7 days ago

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Experience required
6 years minimum
Compensation
€104,000.0
Working hours
Regular working hours
Job source
www.jobleads.com

Tech stack

Application Programming Interfaces (APIs) Databases Data Transformation Python (Programming Language) Performance Tuning Standard Sql Data Ingestion Pyspark Data Pipelines Databricks

Job description

  • Design and develop data pipelines from source systems to Gold layer datasets
  • Implement data ingestion, transformation, and optimization using Databricks
  • Build scalable PySpark-based data processing pipelines
  • Ensure data quality, performance optimization, and maintainability

Requirements

  • Strong hands-on experience in Databricks
  • Advanced PySpark development
  • Experience building end-to-end data pipelines
  • Expertise in data ingestion from multiple sources (APIs, databases, files, etc.)
  • Strong SQL and data transformation skills, Client is specifically looking for strong hands-on engineers who can write PySpark/Python code and implement pipelines independently.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.jobleads.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

Moments

Explore playlists

2:27 min

Managing traffic and tracking costs with Databricks Unity Catalog

Viktoria Semaan Viktoria Semaan · WWC Europe 2026

3:04 min

Database evolution and the funding behind vector databases

Erik Bamberg · LIVE

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

5:19 min

Executing queries and scheduling pipeline jobs within DataWorks

Qiyang Duan · LIVE

1:59 min

Key takeaways and accessing the Databricks developer toolkit

Viktoria Semaan Viktoria Semaan · WWC Europe 2026

2:50 min

Executing LoRA fine-tuning using serverless Databricks AI runtimes

Viktoria Semaan Viktoria Semaan · WWC Europe 2026

Videos

See all
PySpark - Combining Machine Learning & Big Data thumbnail
43:26
LIVE • almost 6 years ago

PySpark - Combining Machine Learning & Big Data

Ayon Roy

Enjoying SQL data pipelines with dbt thumbnail
26:53
WWC 2023 • almost 3 years ago

Enjoying SQL data pipelines with dbt

Matthias Niehoff

Kubernetes and Microservices with Multi-Model Databases thumbnail
29:30
WWC 2022 • about 4 years ago

Kubernetes and Microservices with Multi-Model Databases

Wei Hu

Cutting LLM Costs Without Cutting Quality: How to Beat Proprietary LLMs with Fine-Tuned Open Source thumbnail
29:50
WWC Europe 2026 • about 1 month ago

Cutting LLM Costs Without Cutting Quality: How to Beat Proprietary LLMs with Fine-Tuned Open Source

Viktoria Semaan

Data Science in Retail thumbnail
58:21
LIVE • about 3 years ago

Data Science in Retail

Julian Joseph

Empowering Retail Through Applied Machine Learning thumbnail
22:41
WWC 2024 • almost 2 years ago

Empowering Retail Through Applied Machine Learning

Christoph Fassbach, Daniel Rohr

Related articles

See all