> Markdown version of [/jobs/ext/2816313-data-engineer](https://www.wearedevelopers.com/jobs/ext/2816313-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer - **Company:** Amber Labs Ltd - **Location:** Leeds, UK - **Experience:** Expert - **Contract:** Temporary contract - **Skills:** Application Programming Interfaces (APIs), Agile Methodology, Amazon Web Services, Amazon Elastic Compute Cloud, Amazon S3, Automation of Tests, Big Data, Cloud Engineering, Code Review, Continuous Integration, Information Engineering, Extract Transform Load (ETL), Data Security, Data Warehousing, Identity and Access Management, Python (Programming Language), Systems Development Life Cycle, Power BI, Cloud Services, Standard Sql, SQL Databases, Data Processing, Informatica Powercenter, Gitlab, Git, SC Clearance, Event Driven Architecture, Pyspark, Git Flow, Atlassian Tools, Data Management, Functional Programming, Cloudwatch, Terraform, Software Version Control, Data Pipelines, Amazon Elastic Mapreduce (EMR), Amazon Redshift - **Published:** September 10, 2026 - **Apply:** https://www.collegerecruiter.com/job/2858101356-data-engineer ## About the Role A strong background in AWS, PySpark, and Informatica is essential, alongside experience delivering secure, scalable data solutions within UK Central Government., We're looking for someone with strong technical expertise combined with excellent communication and collaboration skills. You'll have: * Active SC Security Clearance (essential). * Proven experience delivering data engineering solutions within UK Central Government. * Strong commercial experience with Informatica. * Hands-on expertise with AWS services including Amazon EMR, S3 and Lambda. * Advanced PySpark, Python and SQL skills for large-scale data processing. * Experience building and maintaining enterprise-scale batch data pipelines. * Strong understanding of cloud-native data engineering architectures. * Experience modernising legacy ETL platforms and migrating workloads to AWS. * Experience implementing CI/CD pipelines, Infrastructure as Code (Terraform) and automated testing. * Strong knowledge of Git/GitLab, branching strategies and code review practices. * Experience designing and consuming APIs for secure data integration. * Strong understanding of data quality, governance and engineering best practices. * Experience working in Agile delivery teams using Jira and Confluence. * Excellent stakeholder management skills, with the ability to communicate effectively across both technical and non-technical audiences. * Experience producing clear technical documentation and contributing to architectural discussions. It would be advantageous if you also have experience with: * Amazon Redshift and modern data warehousing. * Dimensional data modelling and dbt. * Power BI and supporting Business Intelligence teams with data models. * Wider AWS services including Athena, EC2, CloudWatch and IAM. * Event-driven architectures and modern integration patterns. ## Description As a Senior Data Engineer, you'll design, build, and operate robust data platforms that power mission-critical analytics within a complex UK Government environment. Working closely with architects, engineers, product teams, and stakeholders, you'll develop scalable data pipelines, modernise legacy data platforms, and ensure high standards of engineering across the full software delivery lifecycle. You'll also play an important role in mentoring colleagues and helping shape engineering best practices., * Design, build, and maintain production-grade data pipelines using AWS services including Amazon EMR, S3 and Lambda. * Develop scalable data processing solutions using PySpark, Python and SQL with a focus on performance, resilience, testing and observability. * Lead the migration and modernisation of legacy ETL and reporting workloads into cloud-native architectures. * Develop reusable data engineering components and shared frameworks. * Build and optimise data transformations and models supporting Management Information (MI), reporting and analytics, including downstream Power BI solutions. * Work with Informatica as part of enterprise data integration and migration activities. * Own engineering best practices including CI/CD, automated testing, version control and release governance. * Conduct code reviews and mentor engineers, promoting high-quality engineering standards across delivery teams. * Collaborate with architects, product owners and platform teams to translate business requirements into robust technical solutions. * Participate fully in Agile ceremonies using Jira and Confluence. * Embed security, governance and compliance throughout the engineering lifecycle, ensuring solutions meet UK Government security and data handling requirements. ## Related Videos - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [WeAreDevelopers LIVE - Modern DevOps for IoT Devices and More](https://www.wearedevelopers.com/videos/1805-wearedevelopers-live-modern-devops-for-iot-devices-and-more) - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk) - [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london) - [Software Engineer Salary in The UK](https://www.wearedevelopers.com/magazine/231-software-engineer-salary-in-the-uk) - [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market) - [Fullstack Developer Salary UK](https://www.wearedevelopers.com/magazine/251-fullstack-developer-salary-uk)