> Markdown version of [/jobs/ext/3007908-senior-data-engineer](https://www.wearedevelopers.com/jobs/ext/3007908-senior-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Senior Data Engineer

- **Company:** SF Partners
- **Location:** Manchester, UK
- **Experience:** Expert
- **Salary:** £70,000.0 - £80,000.0
- **Contract:** Permanent contract
- **Skills:** Artificial Intelligence, Automation of Tests, Microsoft Azure, Cloud Computing, Continuous Integration, Information Engineering, Python (Programming Language), Standard Sql, SQL Databases, Apache Spark, Generative AI, Git, Microsoft Fabric, Pyspark, Software Coding, Databricks
- **Published:** September 20, 2026
- **Apply:** https://www.adzuna.co.uk/jobs/details/5890529538

## About the Role

* Strong experience with Python and PySpark
 * Experience with Spark and notebook engineering
 * Experience with Lakehouse / Medallion architecture
 * Experience with Delta and SQL
 * Experience with Azure and Git / CI/CD
 * Experience with automated testing
 * Experience with data quality and observability
 * Experience building reusable engineering patterns
 * Background in Databricks/PySpark environments is particularly desirable
 * Senior-level experience influencing architecture, technical design, coding standards, CI/CD, testing, and engineering best practice

## Description

* Join us as a Senior Data Engineer in our ongoing modernisation of our data capability
 * Work hands-on across Python / PySpark, Microsoft Fabric, Spark and notebook engineering, Lakehouse / Medallion architecture, Delta, SQL, Azure, Git / CI/CD, automated testing, data quality and observability, and reusable engineering patterns
 * Help turn our modern Microsoft Fabric/Azure foundations into a code-led engineering environment
 * Influence architecture, technical design, coding standards, CI/CD, testing, and engineering best practice
 * Support other engineers and take ownership of more complex technical problems
 * Remain deeply technical and hands-on while contributing to the development of our modern data engineering capability

Technologies:

 * AI
 * Azure
 * CI/CD
 * Databricks
 * Fabric
 * Git
 * Support
 * Python
 * PySpark
 * SQL
 * Spark
 * Cloud

More:

We are an established organisation continuing a significant modernisation of our data capability. Over the last couple of years, we have been moving away from a legacy data estate and establishing a modern Microsoft Fabric/Azure platform. This role is a good opportunity for someone who wants to remain deeply technical and hands-on while having more influence over how a modern data engineering capability develops. The long-term direction extends beyond traditional data engineering into AI, Generative AI and intelligent automation. The role is based in the North West, with 1-2 days per week in the office, and the salary is £70,000 - £80,000, with potential flexibility above this for an exceptional candidate.


## Related Videos

- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94)
- [Cutting LLM Costs Without Cutting Quality: How to Beat Proprietary LLMs with Fine-Tuned Open Source](https://www.wearedevelopers.com/videos/100151-cutting-llm-costs-without-cutting-quality-how-to-beat-proprietary-llms-with-fine-tuned-open-source)
- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning)
- [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail)

## Related Articles

- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers)
- [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk)
- [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production)
- [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london)