> Markdown version of [/jobs/ext/1361928-lead-data-engineer](https://www.wearedevelopers.com/jobs/ext/1361928-lead-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Lead Data Engineer

- **Company:** Understanding Recruitment
- **Location:** Greater London, UK
- **Experience:** Expert
- **Salary:** £100,000.0
- **Contract:** Permanent contract
- **Skills:** Artificial Intelligence, Amazon Web Services, Microsoft Azure, Data Architecture, Extract Transform Load (ETL), Python (Programming Language), Machine Learning, Standard Sql, Software Deployment, SQL Databases, Google Cloud, Cloud Platform System, Apache Spark, Pyspark, Virtual Agents, Data Pipelines, Databricks
- **Published:** July 21, 2026
- **Apply:** https://www.understandingrecruitment.com/job/lead-data-engineer/

## About the Role

* Strong experience building cloud-based data platforms
 * Expertise with Python, SQL, Spark/PySpark and Databricks
 * Experience designing scalable data architectures and modern data pipelines
 * Previous technical leadership or mentoring experience
 * Azure, AWS or GCP experience

## Description

Lead Data Engineer - London (Hybrid)

A fast-growing AI and data consultancy that helps global businesses unlock insights from consumer data using cloud-native platforms, machine learning and agentic AI are looking for a Lead Data Engineer to help shape both the technology and the engineering team.

What you'll be doing:

 * Lead the design and delivery of enterprise-scale data and AI platforms
 * Build cloud-native solutions using Databricks, Azure, AWS and GCP
 * Develop scalable ETL/ELT pipelines with Python, PySpark and SQL
 * Define engineering standards and mentor a team of Data & Platform Engineers
 * Work on AI deployment, orchestration and monitoring in production
 * Collaborate with clients, architects, data scientists and product teams to deliver high-impact solutions

What we're looking for:

 * Strong experience building cloud-based data platforms
 * Expertise with Python, SQL, Spark/PySpark and Databricks
 * Experience designing scalable data architectures and modern data pipelines
 * Previous technical leadership or mentoring experience
 * Azure, AWS or GCP experience

What's in it for you?

 * Salary up to £100,000
 * Generous pension contribution, private healthcare, personal learning budget etc.
 * Clear progression and exposure to cutting-edge AI and agentic technologies

Apply now for immediate consideration!


## Related Videos

- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology)
- [Cutting LLM Costs Without Cutting Quality: How to Beat Proprietary LLMs with Fine-Tuned Open Source](https://www.wearedevelopers.com/videos/100151-cutting-llm-costs-without-cutting-quality-how-to-beat-proprietary-llms-with-fine-tuned-open-source)
- [How building an industry DBMS differs from building a research one](https://www.wearedevelopers.com/videos/768-how-building-an-industry-dbms-differs-from-building-a-research-one)
- [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail)
- [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning)

## Related Articles

- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk)
- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)
- [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london)
- [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud)
- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)