Data Engineer

Cabinet Office
Manchester, United Kingdom
31 days ago

Role details

Contract type
Temporary to permanent
Employment type
Part-time / full-time
Working hours
Shift work
Languages
English
Experience level
Senior
Compensation
£ 69K

Job location

Manchester, United Kingdom

Tech stack

Artificial Intelligence
Azure
Network Analysis
Databases
Continuous Integration
Data as a Services
Information Engineering
ETL
Fraud Prevention and Detection
Python
Machine Learning
Metadata
Software Deployment
SQL Databases
Data Processing
PySpark
Information Technology
Data Analytics
Data Pipelines
Databricks

Job description

This role sits within the Data Analytics Service Team. You will be working as our Data Engineer and will be required to review/ design, document, and streamline the ETL processes for the datasets we bring together for analysis and AI projects. We operate in Azure using ABFSS for storage and Databricks Unity catalogue for our data processing. As part of the Senior Management Team, you will ensure new datasets are being added with the correct processes, existing pipelines execute correctly, and proposing changes to these processes going forward in line with best practices. As part of the senior management of the data analytics team, you will also have leadership responsibilities within the PSFA data team to help us improve our services. You will work with the platform lead to identify where and how we should continue to build our Azure tenant to best support the ambitions of the PSFA data analytics service going forward. You will develop relationships with key partners across the civil service, including our key data providers and our cloud provider, to identify how we can work together to improve our tenant., We are recruiting a Data Engineer to help us build and maintain a data model in Microsoft Azure to aid in the development of our network analysis and AI Service offerings. This role will support our mission by working across government to reduce the impact of fraud, representing the Public Sector Fraud Authority (PSFA) externally, and ensuring that our ML, AI and data services deliver maximum value., We'll assess you against these behaviours during the selection process:

  • Making Effective Decisions

  • Changing and Improving

  • Managing a Quality Service, Further details around what this will entail are listed on the application form. Note: In the event of high application volumes - Cabinet Office will sift on the following behaviours:

  • Making Effective Decisions Selection process This vacancy is using Success Profiles, and will assess your Behaviours and Technical skills. We'll assess you against these behaviours during the selection process:

  • Making Effective Decisions

  • Changing and Improving

  • Managing a Quality Service Technical We'll assess your technical ability during the selection process with:

  • Data Engineering - Experience You will be asked at the interview to describe a project you worked on and how it delivered robust data to support analytical work and model development. Technical ability will be assessed against the "Lead Data Engineer" specification on the Government Digital and Data Professional Capability Framework., Please note terms and conditions are attached. Please take time to read the document to determine how these may affect you. Any move to Cabinet Office from another employer will mean you can no longer access childcare vouchers. This includes moves between government departments. You may however be eligible for other government schemes, including Tax Free Childcare. Determine your eligibility at: https://www.childcarechoices.gov.uk A reserve list will be held for a period of 12 months, from which further appointments can be made. If successful and transferring from another Government Department a criminal record check may be carried out. In order to process applications without delay, we will be sending a Criminal Record Check to Disclosure and Barring Service or Disclosure Scotland on your behalf. However, we recognise in exceptional circumstances some candidates will want to send their completed forms direct. If you will be doing this, please advise Government Recruitment Service of your intention by emailing Pre-EmploymentChecks.grs@cabinetoffice.gov.uk stating the job reference number in the subject heading. For further information on the Disclosure Scotland confidential checking service telephone: the Disclosure Scotland Helpline on 0870 609 6006 and ask to speak to the operations manager in confidence, or email Info@disclosurescotland.co.uk Applicants who are successful at interview will be, as part of pre-employment screening, subject to a check on the Internal Fraud Database (IFD). This check will provide information about employees who have been dismissed for fraud or dishonesty offences. This check also applies to employees who resign or otherwise leave before being dismissed for fraud or dishonesty had their employment continued. Any applicant's details held on the IFD will be refused employment. A candidate is not eligible to apply for a role within the Civil Service if the application is made within a 5-year period following a dismissal for carrying out internal fraud against government. New entrants are expected to join on the minimum of the pay band. Please note terms and conditions are attached. Please take time to read the document to determine how these may affect you. Feedback Feedback will only be provided if you attend an interview or assessment.

Security Successful candidates must undergo a criminal record check. Successful candidates must meet the security requirements before they can be appointed. The level of security needed is security check (opens in a new window). See our vetting charter (opens in a new window). People working with government assets must complete baseline personnel security standard (opens in new window) checks.

Nationality requirements This job is broadly open to the following groups: o UK nationals o nationals of the Republic of Ireland o nationals of Commonwealth countries who have the right to work in the UK o nationals of the EU, Switzerland, Norway, Iceland or Liechtenstein and family members of those nationalities with settled or pre-settled status under the European Union Settlement Scheme (EUSS) (opens in a new window) o nationals of the EU, Switzerland, Norway, Iceland or Liechtenstein and family members of those nationalities who have made a valid application for settled or pre-settled status under the European Union Settlement Scheme (EUSS) o individuals with limited leave to remain or indefinite leave to remain who were eligible to apply for EUSS on or before 31 December 2020 o Turkish nationals, and certain family members of Turkish nationals, who have accrued the right to work in the Civil Service Further information on nationality requirements (opens in a new window)

Working for the Civil Service The Civil Service Code (opens in a new window) sets out the standards of behaviour expected of civil servants. We recruit by merit on the basis of fair and open competition, as outlined in the Civil Service Commission's recruitment principles (opens in a new window). The Civil Service embraces diversity and promotes equal opportunities. As such, we run a Disability Confident Scheme (DCS) for candidates with disabilities who meet the minimum selection criteria. The Civil Service also offers a Redeployment Interview Scheme to civil servants who are at risk of redundancy, and who meet the minimum requirements for the advertised vacancy.

Diversity and Inclusion The Civil Service is committed to attract, retain and invest in talent wherever it is found. To learn more please see the Civil Service People Plan (opens in a new window) and the Civil Service Diversity and Inclusion Strategy (opens in a new window).

Apply and further information This vacancy is part of the Great Place to Work for Veterans (opens in a new window) initiative. The Civil Service welcomes applications from people who have recently left prison or have an unspent conviction. Read more about prison leaver recruitment (opens in new window). Once this job has closed, the job advert will no longer be available. You may want to save a copy for your records.

Requirements

  • Degree / Masters in computer science, maths, statistics or related disciplines.

  • Coding background in Python/PySpark and strong SQL skills.

  • Experience working in the Microsoft Azure cloud.

  • Experience in Data Modelling, and understanding best practices when applying data models.

  • Experience in building and maintaining data pipelines (ETL and/or analytical pipelines).

  • Experience working with Databricks as a data hosting/processing tool, or a similar platform (ideally experience with Databricks unity catalogue).

  • Experience in cleansing, managing and transforming high volume data.

  • Understanding of No Code/Metadata driven automation and CI/CD best practices including Azure DevOps.

  • Senior stakeholder management skills including the ability to manage a diverse set of stakeholders and to prioritise needs. It will be beneficial for applicants to have

  • Experience in fraud software deployment; and configuration of fraud detection tools and/or analytics platforms.

  • Experience in fraud, compliance or financial crime.

  • Working with Azure DevOps for CI/CD.

Benefits & conditions

Alongside your salary of £69,308, Cabinet Office contributes £20,078 towards you being a member of the Civil Service Defined Benefit Pension scheme. Find out what benefits a Civil Service Pension provides.

  • Learning and development tailored to your role.
  • An environment with flexible working options.
  • A culture encouraging inclusion and diversity.
  • A Civil Service Pension which provides an attractive pension, benefits for dependants and employer contributions of 28.97%.
  • A minimum of 25 days of paid annual leave, increasing by one day per year up to a maximum of 30.

Apply for this position