> Markdown version of [/jobs/ext/2278422-data-engineer](https://www.wearedevelopers.com/jobs/ext/2278422-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Data Engineer

- **Company:** EF Recruitment
- **Location:** London, UK
- **Experience:** Experienced
- **Salary:** £62,560.0
- **Contract:** Temporary contract
- **Skills:** Java (Programming Language), Artificial Intelligence, Airflow, BigQuery, Software as a Service, Cloud Computing, Continuous Integration, Data Validation, Data Flow Control, Python (Programming Language), Programming Environments, Standard Sql, Cloudera, Shell Script, Software Deployment, Software Engineering, SQL Databases, Data Streaming, Software Technical Review, Google Cloud, Apache Spark, Software Application Programming, Kubernetes, Infrastructure Automation Frameworks, Apache Flink, Terraform, Splunk, New Relic (SaaS), Looker Analytics, Data Pipelines, Apache Beam, Docker
- **Published:** August 28, 2026
- **Apply:** https://www.adzuna.co.uk/jobs/details/5858150968

## About the Role

* 3+ years of experience managing batch and/or streaming data pipelines and infrastructure using technologies such as GCP, Dataflow/Apache Beam, Dataproc, Spark/Flink, or dbt
 * Working knowledge of Python, SQL, and shell scripting
 * Experience with Docker/Kubernetes and infrastructure-as-code tools such as Terraform, Salt, or similar
 * 3+ years of significant professional experience developing applications in a modern programming environment, preferably Scala, Java, and/or Python
 * Professional experience across the entire software development lifecycle, from gathering requirements to production deployment using CI/CD
 * Confidence in articulating complex technical content to peers and partners across the organization via technical design documents

## Description

* Build and maintain scalable data pipelines for BigQuery using Cloud Composer and Airflow
 * Provide observability and monitoring using Monte Carlo and Looker, as well as operational tools such as New Relic and Splunk, to drive reliability, data quality, and robustness
 * Build critical data quality checks to ensure the data we process and provide to partner teams meets security and compliance requirements
 * Participate in code and technical design reviews
 * Scope and plan work with product engineering, data science, and the business
 * Support other teams with data tracking, collection, ingestion, quality monitoring, and alerting

Technologies:

 * Airflow
 * BigQuery
 * CI/CD
 * Cloud
 * Composer
 * Docker
 * Flink
 * GCP
 * Support
 * Java
 * Kubernetes
 * Looker
 * Python
 * SQL
 * Scala
 * Security
 * Spark
 * Splunk
 * Terraform
 * dbt
 * AI, We are a leading global SaaS organisation with an International Engineering team, and we offer the opportunity to contribute to an engineering-focused environment while expanding your experience across technologies such as Cloud Composer, Airflow, Dataflow, Spark, Terraform, and Google Cloud Platform. This is a 12-month hybrid contract role with the potential to become permanent. We also offer hybrid working, a great location with fantastic offices, and an award-winning work environment.


## Related Videos

- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [Our journey with Spring Boot in a microservice architecture](https://www.wearedevelopers.com/videos/511-our-journey-with-spring-boot-in-a-microservice-architecture)
- [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered)
- [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt)
- [AI Model Management Life Circles: ML Ops For Generative AI Models From Research to Deployment](https://www.wearedevelopers.com/videos/1152-ai-model-management-life-circles-ml-ops-for-generative-ai-models-from-research-to-deployment)
- [Docker build without Docker](https://www.wearedevelopers.com/videos/100114-docker-build-without-docker)

## Related Articles

- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Top-Paying Tech Jobs (with Salaries)](https://www.wearedevelopers.com/magazine/372-top-paying-tech-jobs-with-salaries)