> Markdown version of [/jobs/ext/2278245-lead-data-engineer](https://www.wearedevelopers.com/jobs/ext/2278245-lead-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Lead Data Engineer

- **Company:** developrec
- **Location:** Solihull, UK
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Airflow, Computing Platforms, Automation of Tests, BigQuery, Cloud Storage, Software Quality, Code Review, Continuous Integration, Information Engineering, Data Systems, Data Vault Modeling, Dimensional Modeling, Data Flow Control, Python (Programming Language), Standard Sql, Cloudera, Software Engineering, SQL Databases, Data Streaming, Apache Spark, Technical Debt, Git, Infrastructure Automation Frameworks, Data Management, Terraform, Looker Analytics, Data Pipelines
- **Published:** August 28, 2026
- **Apply:** https://www.totaljobs.com/job/lead-data-engineer/develop-job107905239

## About the Role

* Deep experience with GCP, particularly BigQuery, Dataflow, Pub/Sub, Cloud Storage and Cloud Composer/Airflow.
 * Advanced Python and SQL skills with a strong software engineering mindset.
 * Proven experience building complex, scalable batch and event-driven pipelines.
 * Strong data modelling experience, including dimensional modelling, Data Vault or equivalent.
 * Experience with Dataform or similar SQL-based transformation tooling.
 * Understanding of CI/CD, Git, automated testing and infrastructure as code, particularly Terraform.
 * Experience implementing data quality, monitoring, observability and alerting.
 * Ability to lead architecture decisions and communicate technical trade-offs clearly.

Desirable: Spark/DataProc, Looker or similar BI tools, analytics engineering, data mesh/platform architecture, GCP cost optimisation, and experience within retail or e-commerce environments.

## Description

We're looking for an experienced Lead Data Engineer to provide hands-on technical leadership within a data engineering team for a large retail brand. You'll lead the design and delivery of scalable, resilient data platforms and pipelines, set engineering standards, shape technical direction, and mentor engineers. You'll work closely with engineering, data and business stakeholders to solve complex problems and deliver high-quality data solutions., * Lead the technical design and architecture of data pipelines, models and platform components.

 * Establish standards across code quality, testing, security, observability and documentation.
 * Drive technical discovery, design sessions, code reviews and resolution of technical debt.
 * Design and deliver scalable batch and streaming data solutions.
 * Mentor and coach engineers, supporting technical development and knowledge sharing.
 * Make informed recommendations on tools, technologies and architectural approaches.
 * Champion data quality, governance, security and compliance by design.
 * Collaborate with data, product and technology teams to deliver joined-up solutions.
 * Contribute to technical hiring, onboarding and team capability development.


## Related Videos

- [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail)
- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94)
- [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt)
- [Data Governance in the Era of AI](https://www.wearedevelopers.com/videos/1622-data-governance-in-the-era-of-ai)
- [Making Data Warehouses fast. A developer's story.](https://www.wearedevelopers.com/videos/302-making-data-warehouses-fast-a-developer-s-story)

## Related Articles

- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk)
- [MLops – Deploying, Maintaining And Evolving Machine Learning Models in Production](https://www.wearedevelopers.com/magazine/115-mlops-deploying-maintaining-and-evolving-machine-learning-models-in-production)
- [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers)
- [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london)