Senior Data Engineer

SF Partners

Manchester, UK

1 day ago

Apply on www.adzuna.co.uk

Prepare application

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Experience level

Expert

Compensation

£70,000.0 - £80,000.0

Working hours

Regular working hours

Job source

www.adzuna.co.uk

Tech stack

Artificial Intelligence Automation of Tests Microsoft Azure Cloud Computing Continuous Integration Information Engineering Python (Programming Language) Standard Sql SQL Databases Apache Spark Generative AI Git

+4 more

Microsoft Fabric Pyspark Software Coding Databricks

Job description

Join us as a Senior Data Engineer in our ongoing modernisation of our data capability
Work hands-on across Python / PySpark, Microsoft Fabric, Spark and notebook engineering, Lakehouse / Medallion architecture, Delta, SQL, Azure, Git / CI/CD, automated testing, data quality and observability, and reusable engineering patterns
Help turn our modern Microsoft Fabric/Azure foundations into a code-led engineering environment
Influence architecture, technical design, coding standards, CI/CD, testing, and engineering best practice
Support other engineers and take ownership of more complex technical problems
Remain deeply technical and hands-on while contributing to the development of our modern data engineering capability

Technologies:

AI
Azure
CI/CD
Databricks
Fabric
Git
Support
Python
PySpark
SQL
Spark
Cloud

We are an established organisation continuing a significant modernisation of our data capability. Over the last couple of years, we have been moving away from a legacy data estate and establishing a modern Microsoft Fabric/Azure platform. This role is a good opportunity for someone who wants to remain deeply technical and hands-on while having more influence over how a modern data engineering capability develops. The long-term direction extends beyond traditional data engineering into AI, Generative AI and intelligent automation. The role is based in the North West, with 1-2 days per week in the office, and the salary is £70,000 - £80,000, with potential flexibility above this for an exceptional candidate.

Requirements

Strong experience with Python and PySpark
Experience with Spark and notebook engineering
Experience with Lakehouse / Medallion architecture
Experience with Delta and SQL
Experience with Azure and Git / CI/CD
Experience with automated testing
Experience with data quality and observability
Experience building reusable engineering patterns
Background in Databricks/PySpark environments is particularly desirable
Senior-level experience influencing architecture, technical design, coding standards, CI/CD, testing, and engineering best practice