Senior Data Engineer

Home Office
1 month ago

Role details

Contract type
Permanent contract
Employment type
Part-time / full-time
Working hours
Regular working hours
Languages
English
Experience level
Senior
Compensation
£ 52K

Job location

Remote

Tech stack

Microsoft Access
Microsoft Excel
Artificial Intelligence
Data analysis
Cloud Computing
Computer Security
Data as a Services
Information Engineering
Data Integration
ETL
Data Profiling
Data Systems
Data Visualization
Database Design
Systems Analysis
Python
Microsoft Office
Microsoft SQL Server
Reverse Engineering
Data Streaming
T-SQL
Sap Business Objects
Data Strategy
Storage Technologies
Vba Programming Language
Data Analytics
Operational Systems
Data Management
SQL Server Management Studio (SSMS)
Azure
Data Pipelines
Programming Languages

Job description

The Home Office works to build a safe, fair, and prosperous UK. We achieve this through our work on counter-terrorism, policing, crime, drugs policy, immigration, and passports. The Science, Technology, Research and Analysis (STAR) Group sits at the heart of the Home Office. The group ensures the best evidence and analysis are used to address the strategic issues facing the department. We also provide the science, technology, data, and international insights and collaboration capabilities to drive delivery. The challenges and opportunities the Department faces are significant and rapidly changing in the global environment in which we operate. Strong analytical advice is needed to navigate these challenges, and the Home Office has a reputation for putting analysis at the heart of decision-making. Part of the Home Office Analysis & Insight directorate, the Performance Reporting & Analysis Unit (PRAU) provides reporting and analysis of performance for the Migration & Borders Mission and associated operational Capabilities. We support Ministers, the Executive Committee, Policy and Operational leads and other analytical functions with the management information (MI) that they need, as well as producing data for publication and other forms of external release. The Unit also provides advice and support to others in the Department on how to make best use of performance information and is leading on the transformation of MI systems and capabilities. PRAU is geographically spread across four primary locations (Manchester, Liverpool, Sheffield and Croydon)., Senior Data Engineers deliver on the data analytics vision for the organisation as set by the Principal Data Engineer. You will focus on driving the design and implementation of numerous data flows to connect operational systems, data for analytics and BI systems. You will achieve this by leading a small team of Data Engineers through delivering new hybrid datasets, improving existing models and removing barriers to the required business information. As a Senior Data Engineer, you will identify and deliver new data sources and develop Extract, Transform, Load (ETL) processes. You will also collaborate with the Data Acquisition, Analytics and Infrastructure teams to deliver the data strategy through the design and implementation of technology systems. You will support Lead Data Engineers in analysing problems and data analysis issues, looking for underlying causes and assisting in developing solutions. You will also be responsible for delivering data solutions in accordance with agreed organisational standards that ensure services are resilient, scalable and future proof. You will work closely with the Data Services Science community, who will set the scope of your data engineering work through their research of user and business needs and by their designing data pipelines through writing user stories., Day to day duties include but are not limited to:

  • Designing, building and testing data products based on feeds from multiple systems using a range of different storage technologies and/or access methods.

  • Applying the concepts and principles of data modelling to produce, maintain and update relevant data models for specific business needs, including reverse engineering data models from a live system.

  • Undertaking data profiling and source system analysis and presenting clear insights to colleagues to support the end use of the data.

  • Ensuring the development of requirements from full development, test and through to deployment life cycles, while maintaining the schedule of work.

  • Supporting with the development of methods to monitor and improve data quality in source systems using feedback from the Analytics team.

  • Undertaking changes to existing routines following change control procedures and then liaising with team members and other teams to communicate delivery and impact of change.

  • Working with data privacy and information security staff to assure that security and privacy requirements are identified and addressed in your solutions.

  • Working closely with the Data Engineering community to promote challenge from, collaborate with, and ensure an agile approach to working is being adopted.

  • Line managing and leading a small team of Data Engineers, by o supporting their professional development o providing guidance on best practice o assisting in complex data challenges o resolving and escalating delivery blockers Working patterns This role is available on a full-time basis with the option of compressed hours working. This role is also suitable for part-time working hours, with a minimum requirement to work 4 days per week due to business requirements. Travel Occasional travel to other listed hub locations on an approximately quarterly basis. Travel costs incurred for business need, will be reimbursed in line with Home Office travel policy., We'll assess you against these behaviours during the selection process:

  • Changing and Improving

  • Delivering at Pace

  • Making Effective Decisions We only ask for evidence of these behaviours on your application form:

  • Changing and Improving

  • Delivering at Pace

Technical skills We'll assess you against these technical skills during the selection process:

  • Development and Implementation: Data Modelling and Design DTAN - Level 3
  • Development and Implementation: Database design DBDS - Level 3
  • Development and Implementation: Data Engineering DENG - Level 3
  • Strategy and Architecture - Business Strategy and Planning: Innovation INOV - Level 3
  • Technical Strategy and Planning: Data Management DATM - Level 3
  • Technical Strategy and Planning: Methods and Tools METL - Level 3, This vacancy is using Success Profiles (opens in a new window), and will assess your Behaviours, Experience and Technical skills. This gives us the best possible chance of finding the right person for the job, drives up performance and improves diversity and inclusivity. We will endeavour to conduct the selection process in line with the dates indicated below, but cannot guarantee that these will not, where necessary, be revised.
  1. Application - by 20th October 2025. As part of the application process, you will be asked to complete:
  • Personal Statement (maximum 500 words).
  • Evidence of the Behaviours Changing and Improving and Delivering at Pace (maximum of 250 words per Behaviour). The Personal Statement should be aligned to and demonstrate how you meet the skills and experience set out in the essential criteria, detailed in the job description. For guidance and information on how to construct your application (Personal Statement and Behaviours), you are encouraged to visit Civil Service Careers website.
  1. Sift - week commencing 27th October 2025. The sift will be held on the Personal Statement and the Behaviours Changing and Improving and Delivering at Pace. Should a high volume of applications be received, an initial sift will be conducted on the lead Behaviour Changing and Improving. Should there still be high volumes, a further sift will be carried out on the second Behaviour Delivering at Pace and finally a sift on the Personal Statement.

  2. Interview - week commencing 24th November 2025. If you are successful at sift stage, you will be invited to an interview that will be Behaviours and Technical Skills based questions. The interview will take place remotely via MS Teams. For guidance on the Technical skills, please refer to the SFIA 8 Framework - SFIA 8 - English In addition, candidates will be asked to prepare a presentation that will be delivered at interview. The presentation question/scenario will be disclosed closer to the interviews. The presentation will be assessed against the Technical Skills as listed in the job advertisement. For guidance and information on what to expect and how to prepare for an interview, you are encouraged to visit Civil Service Careers. Artificial Intelligence Artificial Intelligence can be a useful tool to support your application; however, all examples and statements provided must be truthful, factually accurate and taken directly from your own experience. Where plagiarism has been identified (presenting the ideas and experiences of others, or generated by artificial intelligence, as your own) applications may be withdrawn and internal candidates may be subject to disciplinary action. Please see our candidate guidance for more information on appropriate and inappropriate use. Problems during the application process If you experience problems accessing this advert, or you think you've made a mistake on an initial application, please contact hocandidates.grs@cabinetoffice.gov.uk, including the vacancy reference, at least two working days before the vacancy closes. Further information can be found on our website. Do not create or attempt to submit another application, online test or use a different Civil Service Jobs account to proceed as this would be in violation of the candidate declaration. Further information In order to process applications without delay, we will be sending a Criminal Record Check to Disclosure and Barring Service on your behalf. However, we recognise in exceptional circumstances some candidates will want to send their completed forms direct. If you will be doing this, please advise Government Recruitment Service of your intention by emailing Pre-EmploymentChecks.grs@cabinetoffice.gov.uk stating the job reference number in the subject heading. Reserve list A reserve list may be held for a period of up to 12 months from which further appointments may be made. There is no guarantee that being held on a reserve list will lead to a job offer. Further information can be found on our website. Standards All Civil Servants are expected to comply with the Civil Service Code, and its core values of integrity, honesty, objectivity and impartiality. Additional Security Checks As well as successfully obtaining UK Security Vetting clearance, candidates will be subject to a range of additional checks. The range of checks carried out will depend on whether you are a current Home Office employee, existing civil servant or an external new entrant as well as the role requirements. The level of Criminal Record Check required for this role is basic. Further details are included in the Notes to Candidates. Reasonable Adjustments If a person with disabilities is at a substantial disadvantage compared to a non-disabled person, we have a duty to make reasonable changes to our processes. If you need a change to be made so that you can make your application, you should:

  • Contact Government Recruitment Service via HOrecruitment.grs@cabinetoffice.gov.uk as soon as possible before the closing date to discuss your needs
  • Complete the "Assistance Required" section in the "Additional Requirements" page of your application form to tell us what changes or help you might need further on in the recruitment process. For instance, you may need wheelchair access at interview, or if you're deaf, a language service professional If you are experiencing accessibility problems with any attachments on this advert, please contact the email address in the 'Contact point for applicants' section. Feedback Feedback will only be provided if you attend an interview or assessment.

Security Successful candidates must undergo a criminal record check. Successful candidates must meet the security requirements before they can be appointed. The level of security needed is security check (opens in a new window). See our vetting charter (opens in a new window). People working with government assets must complete baseline personnel security standard (opens in new window) checks.

Nationality requirements This job is broadly open to the following groups:

  • UK nationals
  • nationals of the Republic of Ireland
  • nationals of Commonwealth countries who have the right to work in the UK
  • nationals of the EU, Switzerland, Norway, Iceland or Liechtenstein and family members of those nationalities with settled or pre-settled status under the European Union Settlement Scheme (EUSS) (opens in a new window)
  • nationals of the EU, Switzerland, Norway, Iceland or Liechtenstein and family members of those nationalities who have made a valid application for settled or pre-settled status under the European Union Settlement Scheme (EUSS)
  • individuals with limited leave to remain or indefinite leave to remain who were eligible to apply for EUSS on or before 31 December 2020
  • Turkish nationals, and certain family members of Turkish nationals, who have accrued the right to work in the Civil Service Further information on nationality requirements (opens in a new window)

Working for the Civil Service The Civil Service Code (opens in a new window) sets out the standards of behaviour expected of civil servants. We recruit by merit on the basis of fair and open competition, as outlined in the Civil Service Commission's recruitment principles (opens in a new window). The Civil Service embraces diversity and promotes equal opportunities. As such, we run a Disability Confident Scheme (DCS) for candidates with disabilities who meet the minimum selection criteria. The Civil Service also offers a Redeployment Interview Scheme to civil servants who are at risk of redundancy, and who meet the minimum requirements for the advertised vacancy.

Diversity and Inclusion The Civil Service is committed to attract, retain and invest in talent wherever it is found. To learn more please see the Civil Service People Plan (opens in a new window) and the Civil Service Diversity and Inclusion Strategy (opens in a new window).

Requirements

  • Experience in the delivery of in data analysis projects, solution design and end user reporting.

  • Experience in T-SQL Development (e.g. via Azure Data Studio / MS SQL Server Management Studio / Azure Synapse).

  • Experience with Cloud-based data integration and analytics technology (e.g. Azure Synapse Analytics).

  • Experience with other data engineering and analysis tooling, such as Advanced MS Excel, MS Access, SAP Business Objects.

  • Familiarity with code development via Visual Basic for Applications (VBA), Python and/or R.

  • An understanding of the analysis of complex data sets, awareness of data modelling techniques and database design.

  • Ability to elicit user requirements and ensure these are confidently and clearly communicated to suppliers and colleagues.

  • Experience in Line Management and/or Project Delivery through others. Desirable criteria

  • Understanding industry recognised data patterns, models, data engineering/science software and programming languages.

  • Experience of working or familiarity with existing Home Office and OGD data sets.

  • A numerate degree or equivalent experience.

Benefits & conditions

  • Learning and development tailored to your role
  • An environment with flexible working options
  • A culture encouraging inclusion and diversity
  • A Civil Service pension with an employer contribution of 28.97%
  • Where business needs allow, some roles may be suitable for a combination of office and home-based working. This is a non-contractual arrangement where all employees will be expected to spend a minimum of 60% of their working time in an office.
  • Plus a Capability and Skills allowance: An additional allowance may be payable, pending a capability and skills assessment, with a value of up to £12,680.

Apply for this position