> Markdown version of [/jobs/ext/366608-senior-data-engineer-edv](https://www.wearedevelopers.com/jobs/ext/366608-senior-data-engineer-edv). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Senior Data Engineer (eDV)

- **Company:** Frontier Resourcing
- **Location:** Cheltenham, UK
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Agile Methodology, Airflow, Amazon Web Services, Amazon S3, Microsoft Azure, Cloud Computing, Code Review, Extract Transform Load (ETL), Distributed Computing Environment, Elasticsearch, Revision Control Systems, Hadoop Distributed File System, Python (Programming Language), Microsoft Message Queuing, NoSQL, OpenShift, SQL Databases, Unstructured Data, Software Organization, Data Storage Technologies, Apache Spark, Pandas, Containerization, Data Lakes, Pyspark, Git Flow, Kubernetes, Apache Kafka, Apache Nifi, Data Management, Video Streaming, Data Pipelines, Serverless Computing, Docker
- **Published:** June 24, 2026
- **Apply:** https://uk.indeed.com/viewjob?jk=2f458738747d804b

## About the Role

* Strong analytical skills with experience working with large-scale and unstructured datasets.
 * Python development experience, including technologies such as PySpark, Pandas and PyArrow.
 * Expertise in distributed data processing frameworks, particularly Apache Spark.
 * Experience building and maintaining ETL pipelines using technologies such as Apache Airflow, AWS Step Functions or Apache NiFi.
 * Cloud platform experience across AWS, Azure and/or GCP.
 * Knowledge of messaging and streaming technologies including Kafka, AWS SQS or equivalent cloud-native services.
 * Strong understanding of SQL and NoSQL databases.
 * Experience with modern data storage technologies including HDFS, Iceberg, Elasticsearch, S3 and Data Lake architectures.
 * Containerisation and orchestration experience using Docker, Kubernetes and/or OpenShift.
 * Knowledge of testing frameworks, engineering standards and software development best practices.
 * Experience working with source control systems, branching strategies, pull requests and code review processes.

## Description

As a Senior Data Engineer, you will join a collaborative Agile environment, playing a key role in designing, building and maintaining scalable data platforms and processing pipelines. You will work alongside software engineers, architects and stakeholders to transform and optimise data for advanced analytical and operational use., * Design, develop and maintain robust data pipelines to ingest, clean, transform and aggregate data from a variety of sources.

 * Collaborate closely with engineers, technical leads and stakeholders to deliver project objectives.
 * Support the successful delivery of project milestones within Agile teams.
 * Contribute to continuous improvement initiatives, engineering best practices and team capability development.
 * Influence technical direction and contribute to architectural and design decisions.


## Related Videos

- [Leveraging Real time data in FSIs](https://www.wearedevelopers.com/videos/806-leveraging-real-time-data-in-fsis)
- [Advanced Typing in TypeScript](https://www.wearedevelopers.com/videos/496-advanced-typing-in-typescript)
- [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered)
- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [Data Science on Software Data](https://www.wearedevelopers.com/videos/162-data-science-on-software-data)
- [Docker build without Docker](https://www.wearedevelopers.com/videos/100114-docker-build-without-docker)

## Related Articles

- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market)
- [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk)
- [Fully Remote Software Engineer Jobs](https://www.wearedevelopers.com/magazine/447-fully-remote-software-engineer-jobs)
- [Frontend Developer Salary in The UK](https://www.wearedevelopers.com/magazine/233-frontend-developer-salary-in-the-uk)
- [Is Software Engineering Over-Saturated?](https://www.wearedevelopers.com/magazine/418-is-software-engineering-over-saturated)