WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
Back

Databricks Data Engineer

Comunidad de Madrid
Madrid, Spain
2 months ago
Apply on www.jobleads.com
Prepare application

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Experience required
6 years minimum
Compensation
€104,000.0
Working hours
Regular working hours
Job source
www.jobleads.com

Tech stack

Application Programming Interfaces (APIs) Databases Data Transformation Python (Programming Language) Performance Tuning Standard Sql Data Ingestion Pyspark Data Pipelines Databricks

Job description

  • Design and develop data pipelines from source systems to Gold layer datasets
  • Implement data ingestion, transformation, and optimization using Databricks
  • Build scalable PySpark-based data processing pipelines
  • Ensure data quality, performance optimization, and maintainability

Requirements

  • Strong hands-on experience in Databricks
  • Advanced PySpark development
  • Experience building end-to-end data pipelines
  • Expertise in data ingestion from multiple sources (APIs, databases, files, etc.)
  • Strong SQL and data transformation skills, Client is specifically looking for strong hands-on engineers who can write PySpark/Python code and implement pipelines independently.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.jobleads.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

Moments

Explore playlists

2:05 min

Enhancing Databricks tooling for software engineering workflows

Alan Mazankiewicz · LIVE

5:14 min

Executing Databricks jobs with built-in Airflow operators

Alan Mazankiewicz · LIVE

4:01 min

Managing application isolation via pluggable database models

Wei Hu Wei Hu · World Congress 2022

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

2:38 min

Overview of Databricks and interactive data processing

Alan Mazankiewicz · LIVE

8:27 min

Building generic custom operators for Databricks APIs

Alan Mazankiewicz · LIVE

Videos

See all
Fully Orchestrating Databricks from Airflow thumbnail
39:14
LIVE • almost 5 years ago

Fully Orchestrating Databricks from Airflow

Alan Mazankiewicz

PySpark - Combining Machine Learning & Big Data thumbnail
43:26
LIVE • almost 6 years ago

PySpark - Combining Machine Learning & Big Data

Ayon Roy

Kubernetes and Microservices with Multi-Model Databases thumbnail
29:30
World Congress 2022 • over 4 years ago

Kubernetes and Microservices with Multi-Model Databases

Wei Hu

Data Science in Retail thumbnail
58:21
LIVE • over 3 years ago

Data Science in Retail

Julian Joseph

Empowering Retail Through Applied Machine Learning thumbnail
22:41
World Congress 2024 • about 2 years ago

Empowering Retail Through Applied Machine Learning

Christoph Fassbach, Daniel Rohr

Fault Tolerance and Consistency at Scale: Harnessing the Power of Distributed SQL Databases thumbnail
32:46
World Congress 2024 • about 2 years ago

Fault Tolerance and Consistency at Scale: Harnessing the Power of Distributed SQL Databases

Wei Hu

Related articles

See all