> Markdown version of [/jobs/ext/2667694-senior-data-engineer-databricks](https://www.wearedevelopers.com/jobs/ext/2667694-senior-data-engineer-databricks). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Senior Data Engineer - Databricks

- **Company:** Anson McCade
- **Location:** London, UK
- **Experience:** Expert
- **Salary:** £149,500.0
- **Contract:** Temporary contract
- **Skills:** Unity 3d, Amazon Web Services, Microsoft Azure, Cloud Computing, Cloud Engineering, Software Quality, Continuous Integration, Data Architecture, Extract Transform Load (ETL), Data Security, Python (Programming Language), Performance Tuning, Cloud Services, SQL Databases, Technical Data Management Systems, Apache Spark, Git, Data Lakes, Pyspark, Data Management, Software Version Control, Data Pipelines, Databricks, Programming Languages
- **Published:** September 2, 2026
- **Apply:** https://www.totaljobs.com/job/senior-data-engineer-databricks/anson-mccade-job107922031

## About the Role

We are seeking an experienced Databricks Lead Engineer to drive the design, development, and optimization of enterprise-scale data platforms. The ideal candidate will have strong technical leadership capabilities, deep expertise in the Databricks Lakehouse platform, and a proven track record of delivering robust data pipelines and architecture in complex environments., * Databricks Expertise: Extensive hands-on experience with Databricks, Delta Lake, Unity Catalog, and Spark optimization.

 * Programming Languages: Advanced proficiency in Python/PySpark and SQL.
 * Cloud & Infrastructure: Strong background in cloud data platforms (Azure, AWS, or GCP) and cloud-native architectures.
 * Engineering Best Practices: Experience with CI/CD pipelines, version control (Git), and infrastructure-as-code.
 * Leadership: Demonstrated experience leading engineering teams, managing workstreams, and driving technical delivery.

## Description

* Lead the design and implementation of scalable data architectures on the Databricks Lakehouse platform.
 * Oversee the development of efficient ETL/ELT pipelines using PySpark, SQL, and Delta Lake.
 * Mentor and guide junior data engineers, promoting best practices in code quality, CI/CD, and performance tuning.
 * Collaborate with data architects, analysts, and stakeholders to translate business requirements into technical data solutions.
 * Ensure data security, governance, and quality standards are maintained across all data workflows.
 * Attend the London office for 3 days per week for collaborative working and stakeholder engagement.


## Related Videos

- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering)
- [Reality and Beyond: Coding a Drone Using {Unity 3D .NET} and ChatGPT AI!](https://www.wearedevelopers.com/videos/702-reality-and-beyond-coding-a-drone-using-unity-3d-net-and-chatgpt-ai)
- [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94)
- [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail)
- [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning)

## Related Articles

- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk)
- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)