> Markdown version of [/jobs/ext/1475137-senior-data-engineer](https://www.wearedevelopers.com/jobs/ext/1475137-senior-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Senior Data Engineer

- **Company:** The BBC
- **Location:** Belfast, UK
- **Experience:** Expert
- **Salary:** £63,000.0 - £73,000.0
- **Contract:** Permanent contract
- **Skills:** Data Analysis, Apache HTTP Server, Encodings, Continuous Delivery, Data Infrastructure, Data Transformation, Data Sharing, Digital Assets, Entity Relationship Models, Python (Programming Language), Software Engineering, SQL Databases, Parquet, Delivery Pipeline, Apache Spark, Data Lakes, AWS Glue
- **Published:** July 29, 2026
- **Apply:** https://uk.indeed.com/viewjob?jk=4a3234041cd3e8f1

## About the Role

* Demonstrable experience of delivering data-powered applications in production
 * Hands-on experience with modern cloud data analysis & engineering (we use SQL, Python, AWS Glue, Apache Iceberg, Apache Parquet, Apache Spark)
 * Experience of modern data transformation pipeline tools such as dbt or SQLMesh
 * Working experience of data modelling (e.g. Entity-Relationship)
 * Experience of managing data quality, for example Great Expectations, AWS Glue Data Quality

DESIRABLE:

 * Knowledge of broadcast media metadata and encoding formats
 * Experience of next generation data tooling such as DuckDB, Polars etc

.buttontext5e59931b164f1563 a{ border: 1px solid transparent; } .buttontext5e59931b164f1563 a: focus{ border: 1px dashed #24d7d8 !important; outline: none !important; }
Disclaimer

This job description is a written statement of the essential characteristics of the job, with its principal accountabilities, incorporating a note of the skills, knowledge and experience required for a satisfactory level of performance. This is not intended to be a complete, detailed account of all aspects of the duties involved.

Please note: If you were to be offered this role, the BBC will conduct Employment screening checks which include Reference checks; Eligibility to work checks; and if applicable to the role, Safeguarding and Adverse media/Social media checks. Any offer made is conditional on these checks being satisfactory.

Before your start date, you may need to disclose any unspent convictions or police charges, in line with our Recruitment policy. This allows us to discuss any support you may need and assess any risks. Failure to disclose may result in the withdrawal of your offer.

## Description

Senior Data Engineer is a hybrid technical/analytical role providing the opportunity to play a key role in analysing a rich seam of broadcast metadata stretching back over 100 years., As a Senior Data Engineer in the AT&S Data Platform team, you will serve as a data subject matter expert, anchor and visionary for our next-generation media metadata platform - Media Content Catalogue. You will be involved with the design, scaling, and optimisation of this modern, cloud-scale lakehouse built on Apache Spark, AWS Glue, and Apache Iceberg/Parquet, transforming complex broadcast & archival media metadata into structured, aggregated, unified, high-performance data assets.

In this role, you will bridge the gap between data analysis & design and hands-on execution, ensuring our data ecosystem delivers the low-latency querying, strict schema evolution, and robust transactional consistency required to power real-time broadcasting insights and downstream archival and media reuse applications., As a Senior Data Engineer in the AT&S Data Platform team, you'll help analyse a wide variety of media metadata sources and contribute to the design, build, and maintenance of a cutting-edge cloud data lake which unites the BBC's multitude of media metadata sources, empowering the search, discovery and broadcast re-use workflows of the future.

You'll work with engineers, data analysts, and product managers to deliver reliable and scalable solutions that underpin the BBC's archive content discovery and reuse lifecycle for many years to come.

The role focuses on:

 * Developing high-quality data schemas, code, tests, documentation and scripts; ensuring they are understandable, maintainable, observable and minimise risk.
 * Develop shared data schemas and contracts for interoperation with upstream and downstream BBC metadata and search systems
 * Participate in the team's software development methodologies, such as pairing, code and documentation review, and continuous delivery. Learning about new technologies and techniques and assess their applicability and usefulness to our products and our users.
 * Help troubleshoot and resolve issues throughout the data life cycle
 * Participate in the team's agile planning and delivery processes
 * Contribute to engineering best practices, testing, and deployment pipelines


## Related Videos

- [Parquet, Delta, Iceberg & Ducklake - An introduction for developers](https://www.wearedevelopers.com/videos/100075-parquet-delta-iceberg-ducklake-an-introduction-for-developers)
- [How we built an AI-powered code reviewer in 80 hours](https://www.wearedevelopers.com/videos/1511-how-we-built-an-ai-powered-code-reviewer-in-80-hours)
- [A Brief History of Data Storage](https://www.wearedevelopers.com/videos/974-a-brief-history-of-data-storage)
- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [OLAP for AI Applications and why you should care](https://www.wearedevelopers.com/videos/100212-olap-for-ai-applications-and-why-you-should-care)
- [Tips, Techniques, and Common Pitfalls Debugging Kafka](https://www.wearedevelopers.com/videos/838-tips-techniques-and-common-pitfalls-debugging-kafka)

## Related Articles

- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk)
- [Software Engineer Salary in The UK](https://www.wearedevelopers.com/magazine/231-software-engineer-salary-in-the-uk)
- [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london)
- [Frontend Developer Salary in The UK](https://www.wearedevelopers.com/magazine/233-frontend-developer-salary-in-the-uk)
- [UK Business Culture and Etiquette](https://www.wearedevelopers.com/magazine/326-uk-business-culture-and-etiquette)