Senior Databricks Engineer

Riskpod
Madrid, Spain
17 days ago
Apply on www.buscojobs.com.es
Prepare application

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Experience required
6 years minimum
Compensation
€104,000.0
Working hours
Regular working hours

Tech stack

Application Programming Interfaces (APIs) Databases Data Transformation Python (Programming Language) Performance Tuning Standard Sql Data Processing Data Ingestion Pyspark Data Pipelines Databricks

Job description

My client is looking for a Databricks Data Engineer - 12 Month Contract paying 400 Euros per day.Work Timings: Swiss/Spanish Business HoursExperience Range: 6-10 yearsMandatory SkillsStrong hands-on experience in DatabricksAdvanced PySpark developmentExperience building end-to-end data pipelinesExpertise in data ingestion from multiple sources (APIs, databases, files, etc.)Strong SQL and data transformation skillsKey ResponsibilitiesDesign and develop data pipelines from source systems to Gold layer datasetsImplement data ingestion, transformation, and optimization using DatabricksBuild scalable PySpark-based data processing pipelinesEnsure data quality, performance optimization, and maintainabilityClient is specifically looking for strong hands-on engineers who can write PySpark/Python code and implement pipelines independently.#J-*****-Ljbffr

Requirements

Strong hands-on experience in Databricks Advanced PySpark development Experience building end-to-end data pipelines Expertise in data ingestion from multiple sources (APIs, databases, files, etc.) Strong SQL and data transformation skills Key Responsibilities Design and develop data pipelines from source systems to Gold layer datasets Implement data ingestion, transformation, and optimization using Databricks Build scalable PySpark-based data processing pipelines Ensure data quality, performance optimization, and maintainability Client is specifically looking for strong hands-on engineers who can write PySpark/Python code and implement pipelines independently. #J-*****-Ljbffr

Benefits & conditions

My client is looking for a Databricks Data Engineer - 12 Month Contract paying 400 Euros per day. Work Timings: Swiss/Spanish Business Hours Experience Range: 6-10 years

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.buscojobs.com.es
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:05 min

Enhancing Databricks tooling for software engineering workflows

Alan Mazankiewicz · LIVE

5:14 min

Executing Databricks jobs with built-in Airflow operators

Alan Mazankiewicz · LIVE

4:01 min

Managing application isolation via pluggable database models

Wei Hu Wei Hu · World Congress 2022

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

2:38 min

Overview of Databricks and interactive data processing

Alan Mazankiewicz · LIVE

8:27 min

Building generic custom operators for Databricks APIs

Alan Mazankiewicz · LIVE

Videos

See all

Related articles

See all