Data Engineer (SQL And Pyspark)
Role details
Job location
Tech stack
Job description
Data Engineer
Location: Dunstable (near Luton) - Hybrid (up to 2 days onsite) Rate: 549 per day (Inside IR35 / Umbrella) Contract: Initial term until end of August
Overview
Whitbread is seeking a hands-on Data Engineer to build and maintain scalable, production-grade data pipelines within reusable, modular frameworks. This role focuses on engineering high-quality, durable solutions rather than one-off development.
Key Responsibilities
Design and develop end-to-end data pipelines using reusable frameworks Build scalable data solutions using Python, SQL, and PySpark Create modular frameworks separating configuration from orchestration Implement robust automated testing (unit, integration, regression) Establish and enforce data quality controls (schema, nulls, row counts, integrity checks) Contribute to CI/CD pipelines and Git-based workflows Troubleshoot and optimise data pipelines for reliability and performance
Required Experience
Strong Data Engineering background Advanced Python and SQL skills Experience with PySpark or distributed processing tools Proven track record building reusable data frameworks Strong testing experience (pytest, mock data, data validation techniques) Solid understanding of data quality, integrity, and pipeline behaviour Experience with CI/CD, Git, and code review processes
Desirable
Experience in enterprise or cloud-based data environments Exposure to dbt, Great Expectations, or similar tools Experience in retail, hospitality, or customer-focused
Requirements
Strong Data Engineering background Advanced Python and SQL skills Experience with PySpark or distributed processing tools Proven track record building reusable data frameworks Strong testing experience (pytest, mock data, data validation techniques) Solid understanding of data quality, integrity, and pipeline behaviour Experience with CI/CD, Git, and code review processes
Desirable
Experience in enterprise or cloud-based data environments Exposure to dbt, Great Expectations, or similar tools Experience in retail, hospitality, or customer-focused