> Markdown version of [/jobs/ext/2308342-lead-data-engineer](https://www.wearedevelopers.com/jobs/ext/2308342-lead-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Lead Data Engineer

- **Company:** Xcede
- **Location:** South Yorkshire, UK
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Artificial Intelligence, Airflow, Amazon Web Services, Computer Programming, Continuous Integration, Information Engineering, Data Systems, Data Warehousing, Python (Programming Language), SQL Databases, Workflow Management Systems, Snowflake, Apache Spark, Generative AI, Git, Integration Frameworks, Data Management, Terraform, Jenkins, Databricks
- **Published:** August 30, 2026
- **Apply:** https://www.collegerecruiter.com/job/2815443435-lead-data-engineer

## About the Role

* Proven background leading data engineering teams or projects in a technology-driven business
 * Expert knowledge of modern cloud data platforms (Databricks, Snowflake, ideally AWS)
 * Advanced Python programming skills and fluency with the wider Python data toolkit
 * Strong capability with SQL, Spark, Airflow, Terraform, and workflow orchestration tools
 * Solid understanding of CICD practices using Git, Jenkins, or equivalent tooling
 * Hands-on experience building both batch and streaming data integration pipelines
 * Depth in data modelling, ingestion, and optimisation for large-scale environments
 * Any exposure to production use of Generative AI is highly advantageous

## Description

This position blends technical leadership with hands-on engineering. You'll oversee the design and delivery of scalable data solutions, lead and mentor a small engineering group, and set the standards for how data is built, managed, and consumed across the organisation.

It's a chance to make architectural decisions, work directly with product and AI specialists, and drive forward best practices in a rapidly modernising environment., * Directing major data engineering initiatives and overseeing a team of engineers

 * Designing and enhancing data warehouses, pipelines, and integration frameworks at scale
 * Partnering with analytics, AI, product, and business teams to create end-to-end data solutions
 * Defining coding guidelines, frameworks, and operating models across the platform
 * Leading the migration of legacy environments into a flexible, cloud-first stack
 * Contributing to the build and delivery of advanced data products and GenAI-enabled applications
 * Raising the bar on data quality, governance, and compliance processes


## Related Videos

- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94)
- [The Road to MLOps: How Verivox Transitioned to AWS](https://www.wearedevelopers.com/videos/1050-the-road-to-mlops-how-verivox-transitioned-to-aws)
- [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt)
- [Our GitOps approach for deploying an Identity Provider and an API Gateway in a SaaS company](https://www.wearedevelopers.com/videos/776-our-gitops-approach-for-deploying-an-identity-provider-and-an-api-gateway-in-a-saas-company)
- [AI Model Management Life Circles: ML Ops For Generative AI Models From Research to Deployment](https://www.wearedevelopers.com/videos/1152-ai-model-management-life-circles-ml-ops-for-generative-ai-models-from-research-to-deployment)

## Related Articles

- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk)
- [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production)
- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)