> Markdown version of [/jobs/ext/2871212-data-engineer](https://www.wearedevelopers.com/jobs/ext/2871212-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Data Engineer

- **Company:** SF Partners
- **Location:** Manchester, UK
- **Salary:** £55,000.0 - £65,000.0
- **Contract:** Permanent contract
- **Skills:** Artificial Intelligence, Microsoft Azure, Cloud Computing, Continuous Integration, Data Infrastructure, Data Systems, Data Warehousing, Distributed Computing Environment, Design of User Interfaces, Python (Programming Language), Standard Sql, SQL Databases, Apache Spark, Generative AI, Git, Microsoft Fabric, Pyspark, Software Version Control, Databricks
- **Published:** September 13, 2026
- **Apply:** https://www.adzuna.co.uk/jobs/details/5880952796

## About the Role

* Strong experience with Python and PySpark
 * Experience working in a modern Databricks, Spark, or Python engineering environment
 * Experience building production-grade data solutions through code
 * Strong understanding of distributed processing
 * Experience with Microsoft Fabric is beneficial, though not essential
 * Experience with Azure Databricks is particularly relevant
 * Experience with SQL, Git/source control, CI/CD, testing, monitoring, and data quality is relevant

## Description

* Develop pipelines, transformations, and data products on top of our new data platform
 * Work in a code-led engineering environment using Python, PySpark, and notebook-based development
 * Build and improve lakehouse solutions using Microsoft Fabric and Azure technologies
 * Work with Spark, Delta tables, and medallion architecture patterns across Bronze, Silver, and Gold layers
 * Contribute to testing, monitoring, and data quality practices
 * Help shape how our organisation uses data, including data products, automation, AI, and Generative AI
 * Solve engineering problems and build robust solutions through code

Technologies:

 * AI
 * Azure
 * CI/CD
 * Databricks
 * Fabric
 * Git
 * Python
 * PySpark
 * SQL
 * Spark
 * Cloud
 * Data Warehouse
 * UX UI Design


## Related Videos

- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94)
- [Cutting LLM Costs Without Cutting Quality: How to Beat Proprietary LLMs with Fine-Tuned Open Source](https://www.wearedevelopers.com/videos/100151-cutting-llm-costs-without-cutting-quality-how-to-beat-proprietary-llms-with-fine-tuned-open-source)
- [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail)
- [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning)

## Related Articles

- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production)
- [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers)
- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)