> Markdown version of [/jobs/ext/1475144-senior-data-engineer](https://www.wearedevelopers.com/jobs/ext/1475144-senior-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Data Engineer - **Company:** Department for Transport - **Location:** London, UK (Remote available) - **Experience:** Expert - **Salary:** £44,241.0 - £58,997.0 - **Contract:** Permanent contract - **Skills:** Agile Methodology, BigQuery, Computer Programming, Databases, Continuous Integration, Data as a Services, Information Engineering, Data Infrastructure, Github, Python (Programming Language), Live Connect (Windows), Software Tools, SQL Databases, Data Logging, Google Cloud, Infrastructure as Code (IaC), Infrastructure Automation Frameworks, Data Analytics, Codebase, Data Management, Data Delivery, Terraform, Data Pipelines, Legacy Systems - **Published:** July 29, 2026 - **Apply:** https://uk.indeed.com/viewjob?jk=5948897eb4bc73c1 ## About the Role To be successful in this role you will need to have the following experience: * Hands-on delivery of robust, maintainable data pipelines in Google Cloud Platform or alternative cloud providers. Including building reusable components, optimising performance and cost, and applying engineering standards and high-quality coding practices. * Proficient user of data engineering tools, including relevant languages (e.g. Python and SQL) and GCP or equivalent cloud tooling (e.g. BigQuery, Cloud Functions). Experience working with or knowledge of CI/CD (e.g. Github Actions), logging and testing, and Infrastructure as Code tools (e.g. Terraform). * Contribution to engineering standards and best practice, supporting the development of maintainable, consistent technical approaches and improving quality across codebases and services. * Experience delivering data engineering work in Agile environments, independently managing components of delivery while contributing to wider team objectives. * Working across technical and non-technical teams to understand requirements, communicate solutions, and support delivery of change and improvement within the data landscape., * Programming and Build (Data Analytics and Engineering) * Problem Management * Data Innovation * Data Development Process, This vacancy is using Success Profiles , and will assess your Behaviours, Experience and Technical skills. ## Description Join the Data Engineering team, a collaborative group of specialists working across Leeds, Birmingham, Hastings and London, delivering the department’s critical data services and cloud-based analytical platforms. You'll work closely with data and digital professionals to develop reliable, scalable solutions, support live services, modernise legacy systems, and help drive innovation. This is an exciting opportunity to contribute to high-impact projects that improve data capabilities and support informed decision-making across the organisation. Your responsibilities will include, but aren’t limited to: * Collaborate with team members and stakeholders to build and operate DfT’s production-grade data pipelines and platforms, ensuring reliability and security across our Google Cloud Platform environment. * Manage live data services; resolving issues at pace to maintain high-quality data delivery for analysts, policy teams and external commitments. * Take a leading role in developing and improving legacy systems, ensuring our data infrastructure is modern and meets ongoing needs. * Support innovation within data engineering, identifying opportunities to modernise tooling, adopt emerging GCP capabilities and introduce new approaches that improve efficiency and data quality. * Work closely with technical and non-technical stakeholders, translating technical concepts, shaping data-related decisions, and responding to business need. * Act as a champion of Infrastructure as Code (IaC), improving and developing repeatable patterns for environments, access, and data services. * Drive the development of our metadata catalogue, curating business and technical metadata so users can effectively discover and use data., * Hands-on delivery of robust, maintainable data pipelines in Google Cloud Platform or alternative cloud providers. Including building reusable components, optimising performance and cost, and applying engineering standards and high-quality coding practices. * Proficient user of data engineering tools, including relevant languages (e.g. Python and SQL) and GCP or equivalent cloud tooling (e.g. BigQuery, Cloud Functions). Experience working with or knowledge of CI/CD (e.g. Github Actions), logging and testing, and Infrastructure as Code tools (e.g. Terraform). * Contribution to engineering standards and best practice, supporting the development of maintainable, consistent technical approaches and improving quality across codebases and services. * Experience delivering data engineering work in Agile environments, independently managing components of delivery while contributing to wider team objectives. * Working across technical and non-technical teams to understand requirements, communicate solutions, and support delivery of change and improvement within the data landscape. The sift will take place week commencing 10/08/2026 Stage 2: Interview At interview stage, you will be assessed against the following Success Profile elements: * Behaviours – Communicating & Influencing, Managing a Quality Service * Technical – Programming and Build (data analytics and engineering) (Level: Practitioner), Problem Management (Level: Working), Data Innovation (Level: Working), Data Development Process (Level: Practitioner) Technical skills will be linked against the Government Digital and Data Profession Capability Framework The interviews will take place week commencing 24/08/2026 This interview will be conducted online via Microsoft Teams. Further details will be provided to you should you be selected for interview. You can find out more about our hiring process, how to apply, and application and interview guidance on our careers site . Please note that we will try to meet the dates set out in the advert. There may be occasions when these dates will change. Reasonable Adjustments As a Disability Confident Leader employer, we are committed to ensuring that the recruitment process is fair, accessible and allows all candidates to perform at their best. If a person with a visible or non-visible disability is substantially disadvantaged, we have a duty to make reasonable changes to our processes., We will also hold a 12-month reserve list for this role, which may lead to potential opportunities beyond the role you applied for. You can read more about our reserve lists here. If your application is successful but you have been dismissed from the Civil Service, your application could be removed at the pre-employment checking stage depending on the nature of the dismissal. Pre-employment Checking Applicants who are successful at interview will be, as part of pre-employment screening, subject to a check on the Internal Fraud Database (IFD). This check will provide information about employees who have been dismissed for fraud or dishonesty offences. This check also applies to employees who resign or otherwise leave before being dismissed for fraud or dishonesty had their employment continued. Any applicant’s details held on the IFD will be refused employment. A candidate is not eligible to apply for a role within the Civil Service if the application is made within a 5-year period following a dismissal for carrying out internal fraud against government. All External applicants and current employees of accredited non-departmental public bodies (NDPBs) will be required to undergo a Social Media Check. A Social Media Check is a review of your publicly available online activity, typically across platforms like LinkedIn, Facebook, X (formerly Twitter), Instagram, and others. The purpose is to identify any public posts or content that could raise concerns for employers, such as: Hate speech or discriminatory behaviour Threats or acts of violence Illegal activity or substance misuse Sexually explicit material Extremist views or affiliations Importantly, this check does not involve hacking into your accounts or accessing private messages. It only considers content you have chosen to make public. Employers use this kind of screening to help ensure their workplace remains safe, inclusive, and aligned with company values. It’s not about judging your personality or lifestyle—it’s about checking for potential red flags that might affect the role or company culture. If you have questions or concerns about the social media check, we would be happy to explain in more detail what’s being looked at and how your data is handled securely and fairly. Feedback will only be provided if you attend an interview or assessment. Security Successful candidates must undergo a criminal record check. Successful candidates must meet the security requirements before they can be appointed. The level of security needed is security check . See our vetting charter . People working with government assets must complete baseline personnel security standard (opens in new window) checks., * UK nationals * nationals of the Republic of Ireland * nationals of Commonwealth countries who have the right to work in the UK * nationals of the EU, Switzerland, Norway, Iceland or Liechtenstein and family members of those nationalities with settled or pre-settled status under the European Union Settlement Scheme (EUSS) * nationals of the EU, Switzerland, Norway, Iceland or Liechtenstein and family members of those nationalities who have made a valid application for settled or pre-settled status under the European Union Settlement Scheme (EUSS) * individuals with limited leave to remain or indefinite leave to remain who were eligible to apply for EUSS on or before 31 December 2020 * Turkish nationals, and certain family members of Turkish nationals, who have accrued the right to work in the Civil Service ## Related Videos - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) - [Getting to Know Your Legacy (System) with AI-Driven Software Archeology](https://www.wearedevelopers.com/videos/1437-getting-to-know-your-legacy-system-with-ai-driven-software-archeology) - [Innovating Developer Tools with AI: Insights from GitHub Next](https://www.wearedevelopers.com/videos/1268-innovating-developer-tools-with-ai-insights-from-github-next) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Data Governance in the Era of AI](https://www.wearedevelopers.com/videos/1622-data-governance-in-the-era-of-ai) - [Why your codebase lies to AI?](https://www.wearedevelopers.com/videos/100281-why-your-codebase-lies-to-ai) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london) - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk) - [Fullstack Developer Salary UK](https://www.wearedevelopers.com/magazine/251-fullstack-developer-salary-uk) - [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market) - [Software Engineer Salary in The UK](https://www.wearedevelopers.com/magazine/231-software-engineer-salary-in-the-uk)