Lead Data Engineer - UK Health Security Agency - G7

Government Digital & Data
Birmingham, UK
3 months ago

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Compensation
£56,185.0 - £70,566.0
Working hours
Regular working hours
Job source

Tech stack

Clean Code Principles Amazon S3 Big Data Information Engineering Data Infrastructure Extract Transform Load (ETL) Data Mart Data Systems Data Warehousing Github Python (Programming Language) Standard Sql
+5 more
Apache Spark Pandas Build Management Data Pipelines Devsecops

Job description

You’ll be part of UKHSA’s Data Engineering and Enablement Division within the Digital and Data Directorate.

In this role, you will:

  • Design and build modern data platforms supporting national health security
  • Work end to end - from stakeholder engagement through to production delivery
  • Help shape and improve engineering standards across the team
  • Act as a technical lead, supporting and guiding others

What you’ll be doing

You’ll be focused on building scalable, secure and high-performing data solutions, including:

  • Designing and delivering ETL/ELT pipelines across multiple data sources
  • Building data orchestration and curated data marts for analytics and insight
  • Re using and extending platform capabilities to deliver efficient solutions
  • Working in agile, multi-disciplinary teams using DevSecOps practices
  • Leading on design, development, testing and deployment of data products

Requirements

We’re interested in engineers who bring strong technical expertise and thrive in collaborative environments:

  • Strong Python experience (Pandas, clean code, testing standards)
  • Experience building large scale data pipelines using Spark
  • Hands on experience with AWS services (Glue, Lambda, Step Functions, S3)
  • Strong SQL and data warehousing experience
  • Experience with GitHub workflows and CI/CD pipelines
  • Ability to collaborate effectively and solve complex data challenges

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on find.jobs

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:03 min

Accelerating pandas dataframes using cudf module plugins

Ankit Patel Ankit Patel · WWC 2024

6:36 min

Funding open source through GitHub Accelerator and Sponsors

Stormy Peters · WWC 2023

3:28 min

Defining big data and machine learning fundamentals

Ayon Roy · LIVE

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

3:33 min

Refactoring data science workflows using Rapids QDF and Pandas

Paul Graham Paul Graham · LIVE

6:58 min

Analyzing production code coverage data using pandas

Markus Harrer Markus Harrer · WWC 2021

Videos

See all

Related articles

See all