> Markdown version of [/jobs/ext/2107981-data-engineer](https://www.wearedevelopers.com/jobs/ext/2107981-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer - **Company:** Department for Work and Pensions (DWP) - **Location:** Broughton, UK (Remote available) - **Salary:** £12,876.0 - **Contract:** Permanent contract - **Skills:** Java (Programming Language), JavaScript (Programming Language), .NET Framework, Agile Methodology, Amazon Web Services, Amazon Elastic Compute Cloud, C Sharp (Programming Language), C++ (Programming Language), Continuous Integration, Extract Transform Load (ETL), Automated Data Processing (ADP), Data Processing, Apache Spark, AWS Lambda, HybridCloud, Pyspark, Data Pipelines, Amazon Elastic Mapreduce (EMR), Legacy Systems - **Published:** August 19, 2026 - **Apply:** https://www.apply4u.co.uk/jobs/x/44482933/ ## About the Role infrastructure using Amazon EC2 and automation tools. Understanding of Agile ways of working and experience contributing to CI/CD delivery practices. Ability to optimise data processing, storage, and queries to improve performance and data quality. Experience designing and automating ETL pipelines using PySpark and Spark SQL.A strong full stack development background with technologies that include .NET 4,8, C#, JavaScript, C++ and Java. You and your role As a Data Engineer in DWP Digital's Management Information (MI) team, you'll help us to deliver modern data engineering solutions that support analytical reporting, business intelligence, and strategic decision-making. We work in a hybrid cloud environment that combines AWS technologies with legacy platforms - here you will design, build, maintain, and optimise scalable data products used by our analysts and data scientists. You will develop and orchestrate PySpark-based ETL pipelines, using technologies such as Amazon EMR, AWS Lambda ## Description DWP. Digital with Purpose. We need a Data Engineer to join our Management Information (MI) team and help shape the future of data at DWP. Working with modern AWS technologies, you'll develop scalable data solutions that power reporting, analytics, and strategic decision-making. Our DWP Digital teams use fresh ideas and leading-edge tech to build and maintain digital solutions that will be used by nearly every person in the UK, every day and at key moments in their lives. DWP is the UK's largest government department. We help people into work and make payments worth over £195bn a year to support and empower millions of people. The scale of what we do is extraordinary, and our purpose is unique. We'd love you to join us. What skills, knowledge and experience will you need? Experience developing and managing PySpark workflows within AWS environments. Knowledge of AWS Lambda and event-driven solutions to support automated data processing. Experience provisioning and supporting cloud ## Related Videos - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Server Side Serverless in Swift](https://www.wearedevelopers.com/videos/133-server-side-serverless-in-swift) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk) - [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Top-Paying Tech Jobs (with Salaries)](https://www.wearedevelopers.com/magazine/372-top-paying-tech-jobs-with-salaries) - [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london)