> Markdown version of [/jobs/ext/1350778-databricks-data-engineer](https://www.wearedevelopers.com/jobs/ext/1350778-databricks-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Databricks Data Engineer

- **Company:** Harnham
- **Location:** London, UK
- **Experience:** Expert
- **Salary:** £130,000.0 - £156,000.0
- **Contract:** Permanent contract
- **Skills:** Data Infrastructure, Standard Sql, Systems Integration, Apache Kafka, Databricks
- **Published:** July 20, 2026
- **Apply:** https://www.reed.co.uk/jobs/databricks-data-engineer/57138796

## About the Role

* Strong experience as a Lead Data Engineer within financial services, ideally pensions or a similarly regulated environment.
 * Proven capability designing and delivering modern data platforms using Databricks and medallion architecture principles.
 * Experience dealing with large volumes of legacy data and integrating it with modern analytics platforms.
 * Confidence defining data use cases and translating business needs into technical delivery.
 * Ability to lead mixed teams across onshore and offshore models and make effective resource allocation decisions.
 * Excellent communication skills, with the credibility to engage senior stakeholders and drive momentum.

Skills

 * sql
 * engineer
 * data engineer
 * airflow
 * kafka
 * databricks
 * dbt

## Description

This freelance opportunity offers the chance to shape the future-state data platform for a large, complex financial services organisation. The focus is on moving from slow, batch-based analytics towards a more modern, streaming-led architecture, with clear ownership over data vision, use cases, and delivery direction.
The Company
They are a well-established organisation operating at scale within the UK financial services and pensions landscape. Managing significant volumes of legacy and live data, they work with both onshore and offshore delivery partners. The business is at a pivotal point in modernising how data is accessed, governed, and used to drive insight. Clear communication and pragmatic decision-making are highly valued.
The Role and Deliverables

 * Define a clear end-to-end data vision, covering current state, target architecture, and practical steps to get there.
 * Lead the design and development of a Databricks-based medallion architecture, with a strong focus on a robust Gold layer for analytics.
 * Improve data availability by shifting from monthly batch processes towards more frequent or streaming ingestion where appropriate.
 * Act as the senior technical decision-maker on data use cases, prioritisation, and trade-offs.
 * Work closely with onshore teams and an offshore partner to unblock progress, clarify ownership, and accelerate delivery.
 * Provide regular, clear updates to senior stakeholders, ensuring alignment on progress and next steps.


## Related Videos

- [How building an industry DBMS differs from building a research one](https://www.wearedevelopers.com/videos/768-how-building-an-industry-dbms-differs-from-building-a-research-one)
- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [How to Benchmark Your Apache Kafka](https://www.wearedevelopers.com/videos/76-how-to-benchmark-your-apache-kafka)
- [Cutting LLM Costs Without Cutting Quality: How to Beat Proprietary LLMs with Fine-Tuned Open Source](https://www.wearedevelopers.com/videos/100151-cutting-llm-costs-without-cutting-quality-how-to-beat-proprietary-llms-with-fine-tuned-open-source)
- [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt)
- [OLTP in the Lakehouse: Redefining Data for AI Workloads](https://www.wearedevelopers.com/videos/2038-oltp-in-the-lakehouse-redefining-data-for-ai-workloads)

## Related Articles

- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk)
- [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london)
- [Software Engineer Salary in The UK](https://www.wearedevelopers.com/magazine/231-software-engineer-salary-in-the-uk)
- [Fullstack Developer Salary UK](https://www.wearedevelopers.com/magazine/251-fullstack-developer-salary-uk)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)