> Markdown version of [/jobs/ext/2786324-senior-data-engineer](https://www.wearedevelopers.com/jobs/ext/2786324-senior-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Senior Data Engineer

- **Company:** Yolk Recruitment Ltd
- **Location:** Cardiff, UK
- **Experience:** Expert
- **Salary:** £65,000.0 - £75,000.0
- **Contract:** Permanent contract
- **Skills:** Agile Methodology, Amazon Web Services, Microsoft Azure, Big Data, Continuous Integration, Data as a Services, Information Engineering, Data Governance, Extract Transform Load (ETL), Data Systems, Apache Hadoop, Python (Programming Language), Machine Learning, Meta-Data Management, NoSQL, Performance Tuning, SQL Databases, Data Streaming, Apache Spark, Kubernetes, Apache Kafka, Terraform, Data Pipelines, Docker
- **Published:** September 8, 2026
- **Apply:** https://www.collegerecruiter.com/job/2840673740-senior-data-engineer

## About the Role

* Extensive experience designing and building large-scale data pipelines and ETL processes.
 * Strong proficiency in SQL and Python.
 * Deep understanding of data modelling, warehousing, and performance optimisation.
 * Proven experience with cloud platforms (AWS, Azure, or GCP) and their data services.
 * Hands-on experience with big data frameworks (e.g. Apache Spark, Hadoop).
 * Strong knowledge of data governance, security, and compliance.
 * Ability to lead technical projects and mentor junior engineers.
 * Excellent problem-solving skills and experience in agile environments., Experience with streaming data (Kafka/Kinesis), Docker/Kubernetes, Terraform, CI/CD pipelines, NoSQL databases, and metadata management tools.

## Description

* Lead the design and implementation of scalable, high-performance data architectures and pipelines.
 * Define and enforce best practices for data engineering, including coding standards, testing, and documentation.
 * Mentor and guide engineers, fostering collaboration and technical excellence.
 * Translate complex business requirements into reliable, well-structured data solutions.
 * Optimise data workflows for performance, reliability, and cost efficiency.
 * Drive adoption of modern data tools and technologies across the organisation.
 * Ensure robust data governance, security, and compliance.
 * Troubleshoot and resolve complex data issues, delivering long-term solutions.
 * Work with analytics, product, and engineering teams to support advanced analytics and machine learning initiatives.


## Related Videos

- [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology)
- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered)
- [Leveraging Real time data in FSIs](https://www.wearedevelopers.com/videos/806-leveraging-real-time-data-in-fsis)
- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [Why and when should we consider Stream Processing frameworks in our solutions](https://www.wearedevelopers.com/videos/1085-why-and-when-should-we-consider-stream-processing-frameworks-in-our-solutions)

## Related Articles

- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk)
- [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market)
- [Fullstack Developer Salary UK](https://www.wearedevelopers.com/magazine/251-fullstack-developer-salary-uk)
- [Fully Remote Software Engineer Jobs](https://www.wearedevelopers.com/magazine/447-fully-remote-software-engineer-jobs)
- [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london)