> Markdown version of [/jobs/ext/2143495-lead-data-engineer-databricks](https://www.wearedevelopers.com/jobs/ext/2143495-lead-data-engineer-databricks). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Lead Data Engineer (Databricks)

- **Company:** Tenth Revolution Group
- **Location:** London, UK
- **Experience:** Expert
- **Salary:** £85,000.0 - £110,000.0
- **Contract:** Permanent contract
- **Skills:** Amazon Web Services, Microsoft Azure, Data Infrastructure, Extract Transform Load (ETL), Distributed Computing Environment, Python (Programming Language), Machine Learning, SQL Databases, Cloud Platform System, Apache Spark, Data Lakes, Databricks
- **Published:** August 20, 2026
- **Apply:** https://www.reed.co.uk/jobs/lead-data-engineer-databricks/57259459

## About the Role

* Proven experience as a Senior or Lead Data Engineer.
 * Deep expertise in Databricks, Spark, Delta Lake, Python and SQL.
 * Experience designing and scaling cloud-based data platforms.
 * Strong knowledge of ETL/ELT, data modelling and distributed processing.
 * Experience with Azure, AWS or GCP environments.
 * Previous team leadership or mentoring experience.
 * Strong stakeholder management and communication skills.

## Description

As Lead Data Engineer, you'll be responsible for:

 * Leading the design, development and optimisation of a Databricks-based data platform.
 * Designing enterprise-scale Lakehouse architectures across cloud platforms.
 * Defining data modelling, governance, security and quality standards.
 * Leading and mentoring a team of Data Engineers.
 * Collaborating with Data Scientists, Analysts and Product teams to support analytics, machine learning and AI initiatives.
 * Driving platform performance, scalability and cloud cost optimisation.


## Related Videos

- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning)
- [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology)
- [Cutting LLM Costs Without Cutting Quality: How to Beat Proprietary LLMs with Fine-Tuned Open Source](https://www.wearedevelopers.com/videos/100151-cutting-llm-costs-without-cutting-quality-how-to-beat-proprietary-llms-with-fine-tuned-open-source)
- [Parquet, Delta, Iceberg & Ducklake - An introduction for developers](https://www.wearedevelopers.com/videos/100075-parquet-delta-iceberg-ducklake-an-introduction-for-developers)
- [OLTP in the Lakehouse: Redefining Data for AI Workloads](https://www.wearedevelopers.com/videos/2038-oltp-in-the-lakehouse-redefining-data-for-ai-workloads)

## Related Articles

- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk)
- [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production)
- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)