Data Engineer (SQL And Pyspark)

Matchtech
Dunstable, United Kingdom
11 days ago

Role details

Contract type
Contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Compensation
£ 143K

Job location

Dunstable, United Kingdom

Tech stack

Automation of Tests
Cloud Database
Code Review
Continuous Integration
Data Validation
Information Engineering
Distributed Computing Environment
Python
Standard Sql
SQL Databases
GIT
Pytest
PySpark
Git Flow
Integration Frameworks
Data Pipelines

Job description

Data Engineer

Location: Dunstable (near Luton) - Hybrid (up to 2 days onsite) Rate: 549 per day (Inside IR35 / Umbrella) Contract: Initial term until end of August

Overview

Whitbread is seeking a hands-on Data Engineer to build and maintain scalable, production-grade data pipelines within reusable, modular frameworks. This role focuses on engineering high-quality, durable solutions rather than one-off development.

Key Responsibilities

Design and develop end-to-end data pipelines using reusable frameworks Build scalable data solutions using Python, SQL, and PySpark Create modular frameworks separating configuration from orchestration Implement robust automated testing (unit, integration, regression) Establish and enforce data quality controls (schema, nulls, row counts, integrity checks) Contribute to CI/CD pipelines and Git-based workflows Troubleshoot and optimise data pipelines for reliability and performance

Required Experience

Strong Data Engineering background Advanced Python and SQL skills Experience with PySpark or distributed processing tools Proven track record building reusable data frameworks Strong testing experience (pytest, mock data, data validation techniques) Solid understanding of data quality, integrity, and pipeline behaviour Experience with CI/CD, Git, and code review processes

Desirable

Experience in enterprise or cloud-based data environments Exposure to dbt, Great Expectations, or similar tools Experience in retail, hospitality, or customer-focused

Requirements

Strong Data Engineering background Advanced Python and SQL skills Experience with PySpark or distributed processing tools Proven track record building reusable data frameworks Strong testing experience (pytest, mock data, data validation techniques) Solid understanding of data quality, integrity, and pipeline behaviour Experience with CI/CD, Git, and code review processes

Desirable

Experience in enterprise or cloud-based data environments Exposure to dbt, Great Expectations, or similar tools Experience in retail, hospitality, or customer-focused

About the company

Whitbread is seeking a hands-on Data Engineer to build and maintain scalable, production-grade data pipelines within reusable, modular frameworks. This role focuses on engineering high-quality, durable solutions rather than one-off development.

Apply for this position