> Markdown version of [/jobs/ext/3226006-senior-data-engineer](https://www.wearedevelopers.com/jobs/ext/3226006-senior-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Senior Data Engineer

- **Company:** Project Recruit
- **Location:** London, UK (Remote available)
- **Experience:** Expert
- **Contract:** Temporary contract
- **Skills:** Query Performance, Amazon Web Services, Amazon Elastic Compute Cloud, Amazon S3, Big Data, Continuous Integration, Customer Data Management, DevOps, Github, Performance Tuning, Systems Development Life Cycle, Software Engineering, SQL Databases, Snowflake, Electronic Medical Records, Pyspark, Machine Learning Operations, Terraform, Software Version Control, Data Pipelines
- **Published:** September 1, 2026
- **Apply:** https://www.careerboard.com/pt/en/find-jobs-in-United-Kingdom/-4EAEA1F93E90C955A2/

## About the Role

* Experience with AWS data stack (S3, EMR, EC2, etc.)
 * PySpark
 * Production-grade data pipelines
 * Performance optimisation and large-scale data processing
 * Snowflake
 * Data modelling (RDV/BDV or similar patterns preferred)
 * Query performance tuning
 * DBT (or equivalent SQL transformation framework)
 * Development of modular, testable data models
 * Experience working in structured transformation frameworks (eg dbt, Grid-style approaches)
 * CI/CD & DevOps
 * Hands-on experience with GitHub Actions (or similar)
 * Exposure to Infrastructure-as-Code (eg Terraform)
 * Experience working in engineering-led environments with strong SDLC practices
 * General engineering maturity
 * Strong software engineering principles (testing, modularity, version control)
 * Experience working in cross-functional product/data teams
 * Ability to contribute to design and solutioning discussions

Desirable Skills:

 * Exposure to MLOps/data science pipelines
 * Previous experience working in retail/large-scale customer data environments

## Description

* Designing, building and maintaining production-grade data pipelines and services across AWS, PySpark, Snowflake and SQL-based transformation frameworks
 * Developing and maintaining modular, testable and high-quality data models and transformation pipelines using DBT or equivalent structured SQL frameworks
 * Improving pipeline robustness through automation, monitoring, validation, dependency management and engineering best practices to reduce manual intervention and production failures
 * Diagnosing and resolving pipeline failures, supporting reruns and validations, and addressing data quality issues to maintain continuity of critical customer-facing use cases
 * Contributing to CI/CD and DevOps practices including GitHub Actions, version control, testing disciplines and exposure to Infrastructure-as-Code such as Terraform


## Related Videos

- [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail)
- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [Innovating Developer Tools with AI: Insights from GitHub Next](https://www.wearedevelopers.com/videos/1268-innovating-developer-tools-with-ai-insights-from-github-next)
- [Shifting Stress to Progress— Understanding DevOps to do DevOps Better](https://www.wearedevelopers.com/videos/268-shifting-stress-to-progress-understanding-devops-to-do-devops-better)
- [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning)
- [Bringing AI Model Testing and Prompt Management to Your Codebase with GitHub Models](https://www.wearedevelopers.com/videos/1536-bringing-ai-model-testing-and-prompt-management-to-your-codebase-with-github-models)

## Related Articles

- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk)
- [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london)
- [Fully Remote Software Engineer Jobs](https://www.wearedevelopers.com/magazine/447-fully-remote-software-engineer-jobs)
- [Fullstack Developer Salary UK](https://www.wearedevelopers.com/magazine/251-fullstack-developer-salary-uk)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)