Data Engineer

The Home Office works to build a safe, fair and prosperous UK. We achieve this through our work on counter-terrorism, policing, crime, drugs policy, immigration and passports. Home Office Digital designs, builds and develops services for the rest of the department and for government. Every year our systems support up to 3 million visa applications, checks on 100 million border crossings, up to 8 million passport applications and deliver 140 million police checks on people, vehicles and property. As a Data Engineer, you will identify, build, modify, manage and deliver new data pipelines and develop new data services to query, enrich and match datasets making use of existing data services. You will collaborate with the Business Analyst, Data Acquisition, Analytics and Infrastructure teams to deliver the data strategy through the design and implementation of technology systems. By joining Data Services and Analytics (DSA) now, you can help drive forward our aim to become recognised as the leading provider of data insight services in Government., Within Home Office Digital, the DSA team find innovative uses for Home Office data and contains one of the most advanced data analytics centres in Government. We strive to lead the way in appropriate and proportionate use of data and analytics to deliver joined-up, intelligent services that unlock the value from data and improve decision making, policy and operations. What this means is a daily opportunity to work with teams across the Home Office's areas of responsibility, from borders, visas and passports, to policing and national security, with some of the largest and most varied datasets and in support of critical national initiatives. DSA consist of technical and non-technical professionals from a wide variety of backgrounds; we are the hub of data expertise within the department. We support our teams with structured learning, both formal and on-the-job, mentoring and feedback. You will support Senior Data Engineers in analysing problems and data analysis issues, looking for underlying causes and assisting in developing solutions. You will also be responsible for delivering data solutions in accordance with agreed organisational standards that ensure services are resilient, scalable and future proof. You will work closely with the Data Services Science community, who will set the scope of your data engineering work through their research of user and business needs and by their designing data pipelines through writing user stories. Your Key Responsibilities

• Collaborate with the Analytics team to develop new data models, enrichment processes, and data streaming systems.

• Design, build, and test data products using feeds from multiple systems and diverse storage technologies. Assist in designing, writing, iterating, and optimising code from prototype to production-ready solutions.

• Conduct data profiling and source system analysis, delivering clear insights to support data-driven decisions. Help develop methods to monitor and improve data quality in source systems, leveraging feedback from the Analytics team.

• Support the delivery of data loads for customers, Data Engineers, and Data Scientists, including troubleshooting and developing new data load programs.

• Provide operational support for live services, working with incident management and other teams to resolve issues promptly. Additional Day-to-Day Activities

• Address changes and bug fixes for complex data products in response to business and product manager requirements.

• Implement changes to existing routines following change control procedures and communicate delivery and impact to relevant teams.

• Engage with the Data Engineering community to foster collaboration, promote agile practices, and mentor new and associate Data Engineers. Working Pattern Due to the business requirements of this role, it is only available on a full-time basis. However, compressed hours are available. Travel Occasional travel may be required to other Home Office locations. Any associated costs will be reimbursed in line with Home Office policy., Please see below for the relevant skills required for your role and refer to the "Skills library" attachment for descriptions. Strategy and Architecture: Business Strategy and Planning

• Innovation (INOV) - Level 2 Technical Strategy and Planning

• Data Management (DATM) - Level 2

• Methods and Tools (METL) - Level 2 Development and Implementation: Systems Development

• Data Modelling and Design (DTAN) - Level 3

• Database Design (DBDS) - Level 2 Data and Analytics

• Data Engineering (DENG) - Level 3, We'll assess you against these behaviours during the selection process: o Changing and Improving o Communicating and Influencing o Making Effective Decisions

Technical skills We'll assess you against these technical skills during the selection process: o Innovation (INOV) - Level 2 o Data Modelling and Design (DTAN) - Level 3 o Database Design (DBDS) - Level 2 o Methods and Tools (METL) - Level 2 o Data Management (DATM) - Level 2 o Data Engineering (DENG) - Level 3, This vacancy is using Success Profiles (opens in a new window), and will assess your Behaviours, Experience and Technical skills. This gives us the best possible chance of finding the right person for the job, drives up performance and improves diversity and inclusivity. We will endeavour to conduct the selection process in line with the dates indicated below, but cannot guarantee that these will not, where necessary, be revised.

1. Application - by 10th December 2025 As part of the application process, you will be asked to complete: o Personal Statement (maximum 1250 words). The Personal Statement should be aligned to and demonstrate how you meet the skills and experience set out in the essential criteria, detailed in the job description. For guidance and information on how to construct your application (Personal Statement), you are encouraged to visit Civil Service Careers website.

2. Sift - week commencing 15th December 2025 The sift will be held on the Personal Statement.

3. Interview - week commencing 12th January 2026 If you are successful at sift stage, you will be invited to an interview that will be Behaviours and Technical Skills based questions. For guidance on the Technical skills, please refer to the SFIA 8 - English The interview will take place via video, using Microsoft Teams. For guidance and information on what to expect and how to prepare for an interview, you are encouraged to visit Civil Service Careers. Artificial Intelligence Artificial Intelligence can be a useful tool to support your application; however, all examples and statements provided must be truthful, factually accurate and taken directly from your own experience. Where plagiarism has been identified (presenting the ideas and experiences of others, or generated by artificial intelligence, as your own) applications may be withdrawn and internal candidates may be subject to disciplinary action. Please see our candidate guidance for more information on appropriate and inappropriate use. Problems during the application process If you experience problems accessing this advert, or you think you've made a mistake on an initial application, please contact hocandidates.grs@cabinetoffice.gov.uk, including the vacancy reference, at least two working days before the vacancy closes. Further information can be found on our website. Do not create or attempt to submit another application, online test or use a different Civil Service Jobs account to proceed as this would be in violation of the candidate declaration. Location Preference You can select up to three locations in order of preference. Please ensure that these are locations you are prepared to travel to. If you are offered a role at one of your preferred location(s) and you decline, your application will be withdrawn. Reserve List A reserve list may be held for a period of up to 12 months from which further appointments may be made. There is no guarantee that being held on a reserve list will lead to a job offer. Further information can be found on our website. Reserve lists will be held for each location. Candidates will be appointed in merit order by location. Candidates judged to be a near miss at interview may be offered a post at the grade below the one advertised without the need to go through a further selection process, providing the role has the same Success Profiles elements and essential skills. There is no guarantee that further such vacancies will arise. Standards All Civil Servants are expected to comply with the Civil Service Code, and its core values of integrity, honesty, objectivity and impartiality. Additional Security Checks As well as successfully obtaining UK Security Vetting clearance, candidates will be subject to a range of additional checks. The range of checks carried out will depend on whether you are a current Home Office employee, existing civil servant or an external new entrant as well as the role requirements. The level of Criminal Record Check required for this role is Basic. Further details are included in the Notes to Candidates. Reasonable Adjustments If a person with disabilities is at a substantial disadvantage compared to a non-disabled person, we have a duty to make reasonable changes to our processes. If you need a change to be made so that you can make your application, you should: o Contact Government Recruitment Service via HOrecruitment.grs@cabinetoffice.gov.uk as soon as possible before the closing date to discuss your needs o Complete the "Assistance Required" section in the "Additional Requirements" page of your application form to tell us what changes or help you might need further on in the recruitment process. For instance, you may need wheelchair access at interview, or if you're deaf, a language service professional If you are experiencing accessibility problems with any attachments on this advert, please contact the email address in the 'Contact point for applicants' section. In order to process applications without delay, we will be sending a Criminal Record Check to Disclosure and Barring Service on your behalf. However, we recognise in exceptional circumstances some candidates will want to send their completed forms direct. If you will be doing this, please advise Government Recruitment Service of your intention by emailing Pre-EmploymentChecks.grs@cabinetoffice.gov.uk stating the job reference number in the subject heading. Feedback Feedback will only be provided if you attend an interview or assessment.

Security Successful candidates must undergo a criminal record check. Successful candidates must meet the security requirements before they can be appointed. The level of security needed is security check (opens in a new window). See our vetting charter (opens in a new window). People working with government assets must complete baseline personnel security standard (opens in new window) checks.

Nationality requirements This job is broadly open to the following groups: o UK nationals o nationals of the Republic of Ireland o nationals of Commonwealth countries who have the right to work in the UK o nationals of the EU, Switzerland, Norway, Iceland or Liechtenstein and family members of those nationalities with settled or pre-settled status under the European Union Settlement Scheme (EUSS) (opens in a new window) o nationals of the EU, Switzerland, Norway, Iceland or Liechtenstein and family members of those nationalities who have made a valid application for settled or pre-settled status under the European Union Settlement Scheme (EUSS) o individuals with limited leave to remain or indefinite leave to remain who were eligible to apply for EUSS on or before 31 December 2020 o Turkish nationals, and certain family members of Turkish nationals, who have accrued the right to work in the Civil Service Further information on nationality requirements (opens in a new window)

Working for the Civil Service The Civil Service Code (opens in a new window) sets out the standards of behaviour expected of civil servants. We recruit by merit on the basis of fair and open competition, as outlined in the Civil Service Commission's recruitment principles (opens in a new window). The Civil Service embraces diversity and promotes equal opportunities. As such, we run a Disability Confident Scheme (DCS) for candidates with disabilities who meet the minimum selection criteria. The Civil Service also offers a Redeployment Interview Scheme to civil servants who are at risk of redundancy, and who meet the minimum requirements for the advertised vacancy.

Diversity and Inclusion The Civil Service is committed to attract, retain and invest in talent wherever it is found. To learn more please see the Civil Service People Plan (opens in a new window) and the Civil Service Diversity and Inclusion Strategy (opens in a new window).

You'll have a demonstrable passion for Data, with the following skills or some experience in:

• A numerate degree or equivalent experience.

• Proficiency in at least one programming language such as Bash, PySpark, Python, or Java.

• Experience using industry-standard ETL tools, network databases, and scheduling/orchestration tools. Strong SQL skills are essential, with the ability to write efficient and complex queries for databases such as Postgres, AWS Redshift, AWS RDS, and AWS Athena.

• Ability to communicate technical concepts clearly and effectively to a range of stakeholders, including those without a technical background.

• Experience in managing the development and delivery of technical products, working collaboratively within multidisciplinary teams.

• Understanding of cloud data technologies, solutions, and emerging strategies. Knowledge of, and ideally experience with, AWS services (e.g., EC2, S3, MSK, ECR, Secrets Manager, Glue) and/or Azure.

• Ability to apply data development and engineering techniques in practice, or a strong aptitude and willingness to learn new skills and technologies. The criteria listed above are reflective of the Home Office Digital Profession Skills and Competency Model (based on the industry standard SFIA framework). SFIA 8 - English (sfia-online.org, Ideally, you will also have the following skills or some experience in:

• Experience working with Big Data tools and data stores, using modern open-source programming languages to deliver robust data engineering solutions, including the Hadoop platform and related services such as HDFS, Hive, YARN, and HBase.

• Understanding of data matching methodologies, with a focus on probabilistic matching techniques, and knowledge of IBM BigMatch, IBM Match360.

In addition to your salary, a career with the Home Office offers a range of benefits, including: o A Civil Service pension with an employer contribution of 28.97%. o In-year reward scheme for one-off or sustained exceptional personal or team achievements. o 25 days annual leave on appointment, rising with service to 30 days. o Eight days of public holidays, plus one additional privilege day. o Where business needs allow, some roles may be suitable for a combination of office and home-based working. This is a non-contractual arrangement where all employees will be expected to spend a minimum of 60% of their working time in an office. o Recruitment and Retention Allowance (RRA): Up to £4000 is available for candidates who demonstrate exceptional skills and experience evidenced at interview stage. o See more of our benefits on our careers website.