Data Engineer

SF Partners

Manchester, UK

7 days ago

Apply on www.adzuna.co.uk

Prepare application

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Compensation

£55,000.0 - £65,000.0

Working hours

Regular working hours

Job source

www.adzuna.co.uk

Tech stack

Artificial Intelligence Microsoft Azure Cloud Computing Continuous Integration Data Infrastructure Data Systems Data Warehousing Distributed Computing Environment Design of User Interfaces Python (Programming Language) Standard Sql SQL Databases

+7 more

Apache Spark Generative AI Git Microsoft Fabric Pyspark Software Version Control Databricks

Job description

Develop pipelines, transformations, and data products on top of our new data platform
Work in a code-led engineering environment using Python, PySpark, and notebook-based development
Build and improve lakehouse solutions using Microsoft Fabric and Azure technologies
Work with Spark, Delta tables, and medallion architecture patterns across Bronze, Silver, and Gold layers
Contribute to testing, monitoring, and data quality practices
Help shape how our organisation uses data, including data products, automation, AI, and Generative AI
Solve engineering problems and build robust solutions through code

Technologies:

AI
Azure
CI/CD
Databricks
Fabric
Git
Python
PySpark
SQL
Spark
Cloud
Data Warehouse
UX UI Design

Requirements

Strong experience with Python and PySpark
Experience working in a modern Databricks, Spark, or Python engineering environment
Experience building production-grade data solutions through code
Strong understanding of distributed processing
Experience with Microsoft Fabric is beneficial, though not essential
Experience with Azure Databricks is particularly relevant
Experience with SQL, Git/source control, CI/CD, testing, monitoring, and data quality is relevant

Benefits & conditions

We are an organisation that has heavily invested in modernising our legacy data estate and are now building on the foundations of a modern Microsoft Fabric/Azure data environment. Our team is growing and focused on developing the next stage of our data capability, with an emphasis on code-led engineering rather than traditional drag-and-drop development. The role offers a salary of £55,000 to £65,000 plus benefits, with a hybrid setup of 1-2 days per week in St Helens. We are open to candidates with commercial Databricks, Spark, or Python experience who want to move deeper into PySpark, distributed processing, and Fabric.