Lead Data Engineer
Role details
Job location
Tech stack
Job description
The Data Engineering Team (DET) builds the company's unified data platform that powers analytics, product features, and ML-handling ingestion, transformation, storage, and delivery at scale. Our team is a cross-functional group of Senior Data Engineers and DevOps Engineers focused on reliability, observability, and developer productivity; you'll collaborate closely with analytics, ML, and product to set technical strategy, implement best practices, and deliver trusted data products used across the business.
As the Lead Data Engineer you will be the subject matter expert on the technology used to extract transform and load data into a format that ultimately the Data Analysts and Data Scientists can use.
Joining our department comes with many benefits, including:
- Employer pension contribution of 28.97% of your salary. Read more about Civil Service Pensions here
- 25 days annual leave, increasing by 1 day each year of service (up to a maximum of 30 days annual leave), plus 8 bank holidays a privilege day for the King's birthday
- Flexible working options where we encourage a great work-life balance.
Read more in the Benefits section below!
Find out more about what it's like working at Driver and Vehicle Standards Agency - Department for Transport Careers, Lead Data Engineer responsible for designing, building, and operating scalable data platforms and pipelines; mentoring engineers; setting architecture and best practices; and collaborating with analytics and ML teams to enable high-quality, production-ready data products.
Your responsibilities will include, but aren't limited to:
- Lead Data Engineers lead and inspire DataOps data engineers to innovate and industrialise the delivery of data products and services into systems and business processes within the organisation. Lead with enthusiasm for finding better more innovative ways to improve service operations, mentoring and coaching junior and senior data engineers to challenge approaches and deliver innovative solutions continually improving operational practices.
- Lead Data Engineers are talented problem solvers, taking a proactive approach to engage with partners, delivery units and senior managers to deliver a joined up end-to-end data operations service.
- As a Lead Data Engineer, you will be responsible for the design, build and deployment of information and data management process-flow systems, working collaboratively with delivery partners to manage process flow implementations where required.
- Lead Data Engineers have a key strategic role in developing service capabilities and the adoption of frameworks for better operational practice. Developing DataOps capabilities and supporting individual's professional growth., We'll assess you against these technical skills during the selection process:
- Programming & Build (Data Engineering)
- Data Modelling
- Data Integration Design, At sift, you will be assessed against the following Success Profile elements:
- Experience - you will be asked to provide a CV (unlimited wordcount) and personal statement (1000-word count). Please structure your Personal Statement to provide detailed evidence of each of the following:
- Proficiency in being able to translate the technical language for a non-technical customer.
- Expertise in integrating and separating data feeds to map, produce, transform, and test new data products at an enterprise level (Integrates and separates data feeds to map, produce, transform, and test new data products).
- Establishes enterprise-scale data integration procedures across the data development lifecycle and ensures that teams adhere to these. Manages resources to ensure that data services work effectively at an enterprise level.
- Knowledge and understanding of a wide range of cloud-based tools and technologies including AWS, Azure and Oracle and the role of data integration and data process-flow.
The sift will take place W/C 27th October 2025.
Stage 2: Interview & Assessment/Presentation
At interview stage, you will be assessed against the following Success Profile elements:
Behaviours
- (Changing & Improving)
Experience
Technical
- Programming & Build (Data Engineering)
- Data Modelling
- Data Integration design
The interviews will take place w/c 10th November 2025.
This interview will be conducted online via Microsoft Teams Further details will be provided to you should you be selected for interview.
You can find out more about our hiring process, how to apply, and application and interview guidance on our careers site .
Please note that we will try to meet the dates set out in the advert. There may be occasions when these dates will change.
Further information on the selection process
Feedback on your application can only be provided if you attend an interview or assessment.
We will also hold a 12 reserve list for this role, which may lead to potential opportunities beyond the role you applied for. You can read more about our reserve lists here.
Should we receive a large number of applications, we may invite a shortlist of the highest performing candidates to interview. This means that some applications that meet the required standard could be placed 'on hold' after the sift and invited to interview if the vacant position(s) remain unfilled. You will be notified if your application is being put 'on hold' once the sift has been completed., As a Disability Confident Leader employer, we are committed to ensuring that the recruitment process is fair, accessible and allows all candidates to perform at their best. If a person with a visible or non-visible disability is substantially disadvantaged, we have a duty to make reasonable changes to our processes., * UK nationals
- nationals of the Republic of Ireland
- nationals of Commonwealth countries who have the right to work in the UK
- nationals of the EU, Switzerland, Norway, Iceland or Liechtenstein and family members of those nationalities with settled or pre-settled status under the European Union Settlement Scheme (EUSS)
- nationals of the EU, Switzerland, Norway, Iceland or Liechtenstein and family members of those nationalities who have made a valid application for settled or pre-settled status under the European Union Settlement Scheme (EUSS)
- individuals with limited leave to remain or indefinite leave to remain who were eligible to apply for EUSS on or before 31 December 2020
- Turkish nationals, and certain family members of Turkish nationals, who have accrued the right to work in the Civil Service
Requirements
Do you have experience in Presentation skills?, You will possess AWS Certified Cloud Practitioner and AWS Certified Data Engineer (Associate); or show a willingness to work towards it.
Required experience:
To be successful in this role you will need to have the following experience:
- Proficiency in being able to translate the technical language for a non-technical customer
- Expertise in integrating and separating data feeds to map, produce, transform and test new data products at an enterprise level (Integrates and separates data feeds to map, produce, transform, and test new data products).
- Establishes enterprise-scale data integration procedures across the data development lifecycle and ensures that teams adhere to these. Manages resources to ensure that data services work effectively at an enterprise level.
- Knowledge and understanding of a wide range of cloud-based tools and technologies including AWS, Azure and Oracle and the role of data integration and data process-flow
- Experience in establishing best-practice data engineering standards and maintaining those standards
- Expertise in data modelling principles, understanding the opportunity for re-use and alignment between data models in different functional areas
- Expertise in identifying areas of innovation in data tools and techniques and recognizing the appropriate timing for adoption
- Leadership experience of delivering technical or analytical solutions
The role is part of the Government Digital and Data (or Government Security Profession Career Framework) profession and utilises an enhanced Capability-Based Pay Framework which provides access to a Digital and Data allowance.
The base pay is £54,857. In addition to this the role includes a Digital and Data allowance of up to £25,543.
The value of allowance awarded will be based on an assessment of your skills and experience as demonstrated through the selection process. Here are more details on the pay framework.
Please note that we do not hold a UK Visa & Immigration (UKVI) Skilled Worker Licence sponsor and are unable to sponsor any individuals for Skilled Worker Sponsorship. Candidates must ensure they have the appropriate rights to work in the UK before application.
Working hours, office attendance and travel requirements
Full time roles consist of 37 hours per week.
Whilst we welcome applications from those looking to work with us on a part time basis, there is a business requirement for the successful candidate to be able to work at least 30 hours per week.
Occasional travel to other offices will be required, which may involve overnight stays.
This role is suitable for hybrid working, which is a non-contractual arrangement where a combination of workplace and home-based working can be accommodated subject to business requirements.
The expectation at present is a minimum of 60% of your working time a month will be spent at either your designated workplace (one of the locations cited in the advert) or, when required for business reasons, in another office/work location. There may be occasions where you are required to attend above the minimum expectation., This vacancy is using Success Profiles , and will assess your Behaviours, Experience and Technical skills., Successful candidates must undergo a criminal record check. Successful candidates must meet the security requirements before they can be appointed. The level of security needed is security check .
Benefits & conditions
£54,857 Plus a government digital & data allowance of up to £25,543. Candidates based in Yeading will receive the London Weighting allowance of £4,000 A Civil Service Pension with an employer contribution of 28.97% GBP, Alongside your salary of £54,857, Driver and Vehicle Standards Agency contributes £15,892 towards you being a member of the Civil Service Defined Benefit Pension scheme. Find out what benefits a Civil Service Pension provides.
Being part of our brilliant Civil Service means you will have access to a wide range of fantastic benefits:
- Employer pension contribution of 28.97% of your salary. Read more about Civil Service Pensions here
- 25 days annual leave, increasing by 1 day each year of service (up to a maximum of 30 days annual leave).
- 8 Bank Holidays plus an additional Privilege Day to mark the King's birthday.
- Access to the staff discount portal.
- Excellent career development opportunities and the potential to undertake professional qualifications relevant to your role paid for by the department, such as CIPD, Prince2, apprenticeships, etc.
- Joining a diverse and inclusive workforce with a range of staff communities to support all our colleagues.
- 24-hour Employee Assistance Programme providing free confidential help and advice for staff.
- Flexible working options where we encourage a great work-life balance.
Find out more about the benefits of working at DfT and its agencies .
