Senior Data Engineer

Government Digital Service
Bristol, UK
18 days ago
Apply on www.indeed.com
Prepare application

Role details

Contract type
Temporary to permanent
Employment type
Full-time (> 32 hours)
Experience level
Expert
Compensation
ÂŁ56,850.0 - ÂŁ67,150.0
Working hours
Shift work
Job source

Tech stack

Data Analysis BigQuery Code Review Continuous Integration Information Engineering Data Infrastructure Data Integration Python (Programming Language) Operational Databases Raw Data SQL Databases Data Streaming
+6 more
Technical Data Management Systems Google Cloud SC Clearance Git Flow Production Code Operational Systems

Job description

You’ll be a technical data expert in GOV.UK and the voice of authority with regards to data infrastructure. You’ll be a key point of contact for our use of Google Cloud and the adoption of new technologies to support and lead the use of data within GOV.UK and GDS driving innovation and best practice.

As a Senior Data Engineer you’ll be uniquely positioned, spanning the data professionals and the technical communities to build links and support cross pollination of work.

As a Senior Data Engineer you’ll:

  • lead on the design and implementation of numerous complex data flows to connect operational systems, data for analytics and business intelligence (BI) systems
  • enable and support teams to make better use of data to improve user experience of government services, through building and refining data models fit for consumption
  • identify, define and evolve the technical standards, architectural principals and target state for GOV.UK’s data infrastructure. Working closely with developers to bring data infrastructure in line with the standards of technical infrastructure
  • identify areas of innovation in data tools and techniques and test and implement improvements
  • be an active member of the tech and data engineering communities in GOV.UK and a technical expert for the GOV.UK Insights and Analytics team. You will be the link that joins our data and technical communities, mentoring, coaching or supporting the development of other data engineers, A reserve list will be held for a period of 12 months, from which further appointments can be made.

The Civil Service is committed to attract, retain and invest in talent wherever it is found. To learn more please see the Civil Service People Plan and the Civil Service D&I Strategy.

Sponsorship

DSIT cannot offer Visa sponsorship to candidates through this campaign. DSIT holds a Visa sponsorship licence but this can only be used for certain roles and this campaign does not qualify., Please note that this role requires SC clearance, which would normally need 5 years’ UK residency in the past 5 years. This is not an absolute requirement, but supplementary checks may be needed where individuals have not lived in the UK for that period. This may mean your security clearance (and therefore your appointment) will take longer or, in some cases, not be possible.

For meaningful checks to be carried out, you will need to have lived in the UK for a sufficient period of time, to enable appropriate checks to be carried out and produce a result which provides the required level of assurance. Whilst a lack of UK residency in itself is not necessarily a bar to a security clearance, and expectation of UK residency may range from 3 to 5 years. Failure to meet the residency requirements needed for the role may result in the withdrawal of provisional jobs offers. Feedback will only be provided if you attend an interview or assessment.

Security

Successful candidates must undergo a basic (or equivalent) criminal record check. Successful candidates must meet the security requirements before they can be appointed. The level of security needed is security check .

See our vetting charter . People working with government assets must complete baseline personnel security standard (opens in new window) checks., * UK nationals

  • nationals of the Republic of Ireland
  • nationals of Commonwealth countries who have the right to work in the UK
  • nationals of the EU, Switzerland, Norway, Iceland or Liechtenstein and family members of those nationalities with settled or pre-settled status under the European Union Settlement Scheme (EUSS)
  • nationals of the EU, Switzerland, Norway, Iceland or Liechtenstein and family members of those nationalities who have made a valid application for settled or pre-settled status under the European Union Settlement Scheme (EUSS)
  • individuals with limited leave to remain or indefinite leave to remain who were eligible to apply for EUSS on or before 31 December 2020
  • Turkish nationals, and certain family members of Turkish nationals, who have accrued the right to work in the Civil Service

Requirements

  • can demonstrate experience of working with good data engineering principals, translating user requirements and raw data into effective, scalable, robust engineering solutions in line with build standards and data regulations, ensuring code is production ready
  • have experience providing technical leadership for data engineering teams, setting priorities and direction while establishing best practice and knowledge gaps
  • have significant practical experience developing production data solutions using Python and SQL, using Git-based workflows, code review and CI/CD practices to manage and deploy production code
  • can demonstrate strong practical background of using Google Cloud, including technologies such as BigQuery, Dataform and Composer
  • can work as part of a multidisciplinary team to plan and prioritise work, sometimes working independently and sometimes pairing with developers/data practitioners, and mentoring, coaching or supporting the development of other data engineers in the community, * a simple application screening process - We only ask for a CV and cover letter of up to 750 words. Important tip - please ensure that your cover letter includes how you meet the skills and experience listed in the “person specification” section above
  • a 20 minute screening call
  • a 80 minute video interview, which includes a presentation on technical task.

Depending on how many applications we get, there might also be an extra stage before the video interview, for example a phone interview or a technical exercise.

In the event we receive a high volume of applications, we will conduct the initial sift against the lead criteria which is:

  • someone who can demonstrate strong practical background of using Google Cloud, including technologies such as BigQuery, Dataform and Composer.

In the Civil Service, we use Success Profiles to evaluate your skills and ability. This gives us the best possible chance of finding the right person for the job, increases performance and improves diversity and inclusivity. We’ll be assessing your technical abilities, skills, experience and behaviours that are relevant to this role.

For this role we’ll be assessing you against the following Civil Service Behaviours:

  • working together
  • changing and improving
  • Making effective decisions
  • communicating and influencing
  • delivering at pace

We’ll also be assessing your experience and specialist technical skills against the following skills defined in the Government Digital and Data Capability Framework for the Senior Data Engineer role:

  • Communicating between the technical and non-technical
  • Data development process
  • Data innovation
  • Data integration design
  • Problem management
  • Technical understanding

Benefits & conditions

ÂŁ56,850 - ÂŁ67,150, There are many benefits of working at GDS, including:

  • flexible hybrid working with flexi-time and the option to work part-time or condensed hours
  • a Civil Service Pension with an average employer contribution of 28.97%
  • 25 days of annual leave, increasing by a day each year up to a maximum of 30 days
  • an extra day off for the King’s birthday
  • an in-year bonus scheme to recognise high performance
  • career progression and coaching, including a training budget for personal development
  • a focus on wellbeing with access to an employee assistance programme
  • job satisfaction from making government services easier to use and more inclusive for people across the UK
  • advances on pay, including for travel season tickets
  • death in service benefits
  • cycle to work scheme and facilities
  • access to an employee discounts scheme
  • 10 learning days per year
  • volunteering opportunities (5 special leave days per year)
  • access to a suite of learning activities through Civil Service learning

Any move to Government Digital Service from another employer will mean you can no longer access childcare vouchers. This includes moves between government departments. You may however be eligible for other government schemes, including Tax Free Childcare. Determine your eligibility at https://www.childcarechoices.gov.uk

Office attendance The Department operates a discretionary hybrid working policy, which provides for a combination of working hours from your place of work and from your home in the UK. The current expectation for staff is to attend the office or non-home based location for 40-60% of the time over the accounting period. DSIT does not normally offer full home working (i.e. working at home); but we do offer a variety of flexible working options (including occasionally working from home).

About the company

The Government Digital Service (GDS) is the digital centre of government. We are responsible for setting, leading and delivering the vision for a modern digital government.

Our priorities are to drive a modern digital government, by:

  • joining up public sector services
  • harnessing the power of AI for the public good
  • strengthening and extending our digital and data public infrastructure
  • elevating leadership and investing in talent
  • funding for outcomes and procuring for growth and innovation
  • committing to transparency and driving accountability

We are home to the Incubator for Artificial Intelligence (I.AI), the world-leading GOV.UK and at the forefront of coordinating the UK’s geospatial strategy and activity. We lead the Government Digital and Data function and champion the work of digital teams across government.

We’re part of the Department for Science, Innovation and Technology (DSIT) and employ more than 1,000 people all over the UK, with hubs in Manchester, London and Bristol.

The Government Digital Service is where talent translates into impact. From your first day, you’ll be working with some of the world’s most highly-skilled digital professionals, all contributing their knowledge to make change on a national scale.

Join us for rewarding work that makes a difference across the UK. You’ll solve some of the nation’s highest-priority digital challenges, helping millions of people access services they need

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.indeed.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt ¡ LIVE

4:09 min

Challenges of interpreting raw data with language models

Clemens Vasters Clemens Vasters ¡ World Congress 2025

5:02 min

Mapping Git flow branches to application tester segments

Majid Hajian ¡ LIVE

3:27 min

Explaining query execution overhead and caching limitations in BigQuery

Adnan Rahic ¡ JS Congress

2:09 min

Uncovering hidden coordinate manipulation communities in binary data

Nolan Royalty ¡ Coffee With Developers

3:53 min

Introduction to git flow and clean feature branches

Johannes Haux ¡ World Congress 2022

Videos

See all

Related articles

See all