WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
Back

Data Engineer

True North Consulting Group Ltd
UK
8 days ago
Apply on www.securityclearedjobs.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Compensation
£84,500.0
Working hours
Regular working hours
Job source
www.securityclearedjobs.com

Tech stack

Amazon S3 Apache HTTP Server Python (Programming Language) Pyspark AWS Glue Terraform

Requirements

Skills: Data pipeline engineering - ingestion, transformation, CDC, scheduling, AWS lakehouse build (Glue, S3/Iceberg, MWAA), patterns & reusable templates. Tools: AWS Glue / S3 / MWAA; Apache Iceberg / Python / Pyspark / Terraform

Benefits & conditions

£325 per day (inside IR35)

Working for a consultancy client on projects for HMRC.

Data Engineer x 2 (SFIA 4)

  1. Owns building data source connectivity and transformation pattern templates.
  2. Owns designing complex pipeline patterns for large and XL-complexity feeds including CDC and parallel load.
  3. Supports Lead Data engineer in pattern designs for correctness, performance and reusability before feed supplier handover.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.securityclearedjobs.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

Moments

Explore playlists

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

55 sec

Validating data processing architectures via containerized events

Modood Alvi · World Congress 2025

3:43 min

The enduring legacy of the amazon S3 storage API

Chris Heilmann Chris Heilmann +3 · LIVE

2:57 min

Core technical practices for robust data engineering

Sandhya Menon Sandhya Menon · World Congress 2026 Europe

1:43 min

AWS infrastructure stack and data flow pipeline overview

Artem Volk Artem Volk +1 · World Congress 2024

3:37 min

Scaling machine learning pipelines from prototypes to petabytes

Julian Joseph · LIVE

Videos

See all
PySpark - Combining Machine Learning & Big Data thumbnail
43:26
LIVE • almost 6 years ago

PySpark - Combining Machine Learning & Big Data

Ayon Roy

How we built an AI-powered code reviewer in 80 hours thumbnail
28:07
World Congress 2025 • about 1 year ago

How we built an AI-powered code reviewer in 80 hours

Yan Cui

WeAreDevelopers LIVE - CSS is DOOMed thumbnail
59:11
LIVE • 6 months ago

WeAreDevelopers LIVE - CSS is DOOMed

Chris Heilmann, Daniel Cranney, Justin Halsall, Christian Schaefer

Enjoying SQL data pipelines with dbt thumbnail
26:53
World Congress 2023 • almost 3 years ago

Enjoying SQL data pipelines with dbt

Matthias Niehoff

Empowering Retail Through Applied Machine Learning thumbnail
22:41
World Congress 2024 • about 2 years ago

Empowering Retail Through Applied Machine Learning

Christoph Fassbach, Daniel Rohr

Data Science in Retail thumbnail
58:21
LIVE • over 3 years ago

Data Science in Retail

Julian Joseph

Related articles

See all