> Markdown version of [/jobs/ext/2871054-data-engineer-databricks](https://www.wearedevelopers.com/jobs/ext/2871054-data-engineer-databricks). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Data Engineer - Databricks

- **Company:** ecruit
- **Location:** London, UK (Remote available)
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Amazon Web Services, Microsoft Azure, Cloud Computing, Continuous Integration, Information Engineering, Extract Transform Load (ETL), Data Transformation, Data Warehousing, Python (Programming Language), Machine Learning, SQL Databases, Apache Spark, Software Troubleshooting, Data Lakes, Pyspark, Information Technology, Machine Learning Operations, Terraform, Data Pipelines, Databricks
- **Published:** September 13, 2026
- **Apply:** https://www.jobs.service.gov.uk/jobs/6aa405f63046452f0149aefc/apply

## About the Role

Are you an experienced Data Engineer who enjoys turning complex data into reliable, scalable solutions? Do you have strong hands-on experience with Databricks, PySpark, Python and SQL?, 5+ years' Data Engineering experience.

Strong hands-on Databricks, PySpark, Python and SQL skills.

Experience building and optimising ETL/ELT data pipelines.

Knowledge of Delta Lake and data warehousing.

Experience with at least one of AWS, Azure or GCP.

Strong troubleshooting and problem-solving skills.

A Computer Science or related technical background.

Experience with Unity Catalog, MLflow, CI/CD, Terraform or Databricks certification would be a bonus.

## Description

7Dxperts is looking for a Senior Data Engineer - Databricks to join our UK team.

You'll build and improve data pipelines that solve real business problems, working with modern Databricks and cloud technologies. Alongside hands-on development, you'll troubleshoot issues, improve performance and work closely with engineers, analysts, data scientists and technical leads.

Key Responsibilities

You will:

Build scalable pipelines using Databricks, Spark and PySpark.

Develop ETL/ELT and data transformation workflows using Python and SQL.

Create and maintain Databricks notebooks, jobs, workflows and clusters.

Work with Delta Lake and lakehouse architectures.

Monitor, troubleshoot and optimise pipeline performance.

Maintain high standards of data quality and reliability.

Work across AWS, Azure or GCP environments.

Automate processes and create reusable engineering solutions.

Support and mentor junior Data Engineers.


## Related Videos

- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [Infrastructure as Code: The Developer's Secret Weapon](https://www.wearedevelopers.com/videos/1221-infrastructure-as-code-the-developer-s-secret-weapon)
- [Cutting LLM Costs Without Cutting Quality: How to Beat Proprietary LLMs with Fine-Tuned Open Source](https://www.wearedevelopers.com/videos/100151-cutting-llm-costs-without-cutting-quality-how-to-beat-proprietary-llms-with-fine-tuned-open-source)
- [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail)
- [OLTP in the Lakehouse: Redefining Data for AI Workloads](https://www.wearedevelopers.com/videos/2038-oltp-in-the-lakehouse-redefining-data-for-ai-workloads)

## Related Articles

- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk)
- [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london)
- [Where To Find Software Engineering Jobs](https://www.wearedevelopers.com/magazine/396-where-to-find-software-engineering-jobs)
- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market)