WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
Back

Databricks Data Engineer

TRIA
London, UK
3 days ago
Apply on www.careerboard.com
Prepare application

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Compensation
£143,000.0
Working hours
Regular working hours
Job source
www.careerboard.com

Tech stack

Application Programming Interfaces (APIs) Microsoft Azure Information Engineering Extract Transform Load (ETL) Data Transformation Python (Programming Language) SQL Databases Data Ingestion Azure Data Factory Databricks

Job description

  • Build and maintain data ingestion pipelines using Databricks.
  • Connect to multiple data sources including SQL databases, APIs and Azure services.
  • Develop pipelines using Azure Data Factory and Databricks Lakeflow.
  • Implement appropriate ingestion strategies including incremental and batch loads.
  • Develop ETL/ELT processes using Databricks Medallion Architecture.
  • Write and maintain Python data engineering code.
  • Use dbt for data transformation and modelling.
  • Ensure pipelines are scalable, reliable and maintainable.

Requirements

  • Strong commercial Databricks experience.
  • Proven data ingestion experience.
  • Azure Data Factory.
  • Databricks Lakeflow.
  • SQL and API integration.
  • Medallion Architecture.
  • Strong Python.
  • dbt.
  • Experience with incremental/batch data ingestion.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerboard.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

Moments

Explore playlists

1:59 min

Key takeaways and accessing the Databricks developer toolkit

Viktoria Semaan Viktoria Semaan · World Congress 2026 Europe

2:27 min

Managing traffic and tracking costs with Databricks Unity Catalog

Viktoria Semaan Viktoria Semaan · World Congress 2026 Europe

1:14 min

Evolution of distributed SQL database architectures

Wei Hu Wei Hu · World Congress 2024

1:06 min

Ingesting streaming data securely with managed hubs

Eldert Grootenboer +1 · World Congress 2023

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

2:50 min

Executing LoRA fine-tuning using serverless Databricks AI runtimes

Viktoria Semaan Viktoria Semaan · World Congress 2026 Europe

Videos

See all
Enjoying SQL data pipelines with dbt thumbnail
26:53
World Congress 2023 • almost 3 years ago

Enjoying SQL data pipelines with dbt

Matthias Niehoff

When React Meets Reality: Building a Real-Time Control Room for Autonomous Vehicles thumbnail
27:22
Europe 2026 Virtual • about 1 month ago

When React Meets Reality: Building a Real-Time Control Room for Autonomous Vehicles

Mykhailo Naumenko

Fault Tolerance and Consistency at Scale: Harnessing the Power of Distributed SQL Databases thumbnail
32:46
World Congress 2024 • almost 2 years ago

Fault Tolerance and Consistency at Scale: Harnessing the Power of Distributed SQL Databases

Wei Hu

Cutting LLM Costs Without Cutting Quality: How to Beat Proprietary LLMs with Fine-Tuned Open Source thumbnail
29:50
World Congress 2026 Europe • about 1 month ago

Cutting LLM Costs Without Cutting Quality: How to Beat Proprietary LLMs with Fine-Tuned Open Source

Viktoria Semaan

OLTP in the Lakehouse: Redefining Data for AI Workloads thumbnail
24:36
Europe 2026 Virtual • about 1 month ago

OLTP in the Lakehouse: Redefining Data for AI Workloads

Oleksandra Bovkun

TiDB, One Layer at a Time: How Distributed SQL Became an Agentic AI Backbone thumbnail
27:27
World Congress 2026 Europe • about 1 month ago

TiDB, One Layer at a Time: How Distributed SQL Became an Agentic AI Backbone

Daniël van Eeden, Mattias Jonsson

Related articles

See all