> Markdown version of [/jobs/ext/3810128-data-engineer](https://www.wearedevelopers.com/jobs/ext/3810128-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Data Engineer

- **Company:** 17918
- **Location:** Otterburn, UK (Remote available)
- **Experience:** Expert
- **Salary:** £16,786.0
- **Contract:** Permanent contract
- **Skills:** Microsoft Azure, Data Infrastructure, Extract Transform Load (ETL), Data Transformation, Data Mining, Data Systems, Distributed Computing Environment, Apache Hive, Python (Programming Language), Pyspark, Data Management, Data Pipelines
- **Published:** October 18, 2026
- **Apply:** https://www.apply4u.co.uk/jobs/data-engineer/52520564

## About the Role

specifications and define effective testing approaches, Experience leading the resolution of complex data, platform and pipeline issues across strategic, tactical and operational levels. Strong knowledge of migrating and transforming data from legacy and on-premise systems to cloud platforms. Expertise in automating ETL/ELT pipelines using PySpark and Spark SQL across Azure-based data environments. You and your role As a Data Engineer, you will design build and enhance scalable ETL/ELT pipelines using Python and PySpark, ensuring data solutions are reliable, efficient and aligned with engineering best practice. You'll work closely with stakeholders to understand complex business requirements, transforming data into trusted, high-quality datasets that enable valuable insights, reporting and decision-making. You will manage and optimise data across multiple platforms, ensuring it is secure, accessible and fit for purpose, while supporting effective database management and data extraction

## Description

Technical Oversight Team, providing technical assurance and governance across data platforms, products and services (Blackpool, Manchester, Leeds and Newcastle). Technology Services - delivering the secure cloud, connectivity, network and security foundations that underpin DWP's digital services (Manchester, Blackpool, Newcastle, Leeds and Birmingham). Successful candidates will be matched to the most suitable business area, with team and location details discussed during the recruitment process. What skills, knowledge and experience will you need? Proven experience designing and delivering complex ETL/ELT pipelines, managing priorities and driving quality outcomes. Ability to communicate complex technical concepts clearly to technical and non-technical audiences, including senior stakeholders. Strong understanding of cloud and distributed data processing, designing scalable, resilient and maintainable data solutions. Proven ability to analyse complex requirements, produce clear