WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
Back

Data Engineer

True North Consulting Group Ltd
UK
8 days ago
Apply on www.securityclearedjobs.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Compensation
£110,500.0
Working hours
Regular working hours
Job source
www.securityclearedjobs.com

Tech stack

Amazon S3 Apache HTTP Server Code Review Information Engineering Python (Programming Language) Pyspark AWS Glue Terraform Data Pipelines

Job description

  1. Leads data engineering delivery across source connectivity and transformation patterns, accountable for sprint output and quality.
  2. Designs complex pipeline patterns for large and XL-complexity feeds including CDC and parallel load, and governs their reusability before feed supplier handover.
  3. Mentors Data Engineers, conducts design reviews and enforces data engineering standards across the team.

Requirements

Skills: Data pipeline design and pattern governance; CDC and incremental load engineering; technical leadership and code review Tools: AWS Glue / S3 / MWAA; Apache Iceberg / Python / Pyspark / Terraform

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.securityclearedjobs.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

Moments

Explore playlists

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

55 sec

Validating data processing architectures via containerized events

Modood Alvi · World Congress 2025

3:43 min

The enduring legacy of the amazon S3 storage API

Chris Heilmann Chris Heilmann +3 · LIVE

2:57 min

Core technical practices for robust data engineering

Sandhya Menon Sandhya Menon · World Congress 2026 Europe

3:37 min

Scaling machine learning pipelines from prototypes to petabytes

Julian Joseph · LIVE

2:15 min

Empowering domain teams with an open data platform

Sandhya Menon Sandhya Menon · World Congress 2026 Europe

Videos

See all
Enjoying SQL data pipelines with dbt thumbnail
26:53
World Congress 2023 • almost 3 years ago

Enjoying SQL data pipelines with dbt

Matthias Niehoff

PySpark - Combining Machine Learning & Big Data thumbnail
43:26
LIVE • almost 6 years ago

PySpark - Combining Machine Learning & Big Data

Ayon Roy

How we built an AI-powered code reviewer in 80 hours thumbnail
28:07
World Congress 2025 • about 1 year ago

How we built an AI-powered code reviewer in 80 hours

Yan Cui

WeAreDevelopers LIVE - CSS is DOOMed thumbnail
59:11
LIVE • 6 months ago

WeAreDevelopers LIVE - CSS is DOOMed

Chris Heilmann, Daniel Cranney, Justin Halsall, Christian Schaefer

Empowering Retail Through Applied Machine Learning thumbnail
22:41
World Congress 2024 • about 2 years ago

Empowering Retail Through Applied Machine Learning

Christoph Fassbach, Daniel Rohr

Data Science in Retail thumbnail
58:21
LIVE • over 3 years ago

Data Science in Retail

Julian Joseph

Related articles

See all