> Markdown version of [/jobs/ext/2111410-data-engineer](https://www.wearedevelopers.com/jobs/ext/2111410-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Data Engineer

- **Company:** Ef Recruitment
- **Location:** Greater London, UK
- **Experience:** Experienced
- **Contract:** Contract
- **Skills:** Java (Programming Language), Artificial Intelligence, Airflow, BigQuery, Software as a Service, Continuous Integration, Data Validation, Data Flow Control, Python (Programming Language), Programming Environments, Newrelic, Cloudera, Shell Script, Software Deployment, Software Engineering, SQL Databases, Data Streaming, Software Technical Review, Google Cloud, Apache Spark, Software Application Programming, Kubernetes, Apache Flink, Terraform, Splunk, Looker Analytics, Data Pipelines, Apache Beam, Docker
- **Published:** August 19, 2026
- **Apply:** https://www.cv-library.co.uk/job/225330352/data-engineer

## About the Role

* 3+ years of experience managing batching and/or streaming data pipelines and infrastructure using technologies such as GCP, Dataflow/Apache Beam, Dataproc, Spark/Flink, dbt;
 * Working knowledge of Python, SQL and shell scripting;
 * Experience with Docker/k8s and "infrastructure as a code" tools such as Terraform, Salt or similar;
 * 3+ years of significant professional experience developing applications written in a modern programming environment - preferably Scala/Java and/or Python;
 * Professional experience across the entire software development life cycle, from gathering requirements to production deployment using CI & CD;
 * Confident at articulating complex technical content to peers and partners across the organization via Technical Design Documents.

## Description

Our client, a leading global SaaS organisation is looking for a Data Engineer to join their International Engineering team.

This is a great opportunity to contribute greatly to an extremely engineering-focused organization and further your experience across technologies such as Cloud Composer, Airflow, Dataflow, Spark, Terraform, Google Cloud Platform, etc;

You will own engineering efforts to provide partner teams within the organisation with data sources that build the AI/ML user experience. This a contract role 12 months Hybrid role with the opportunity for the role go permanent.

What You'll Do:

 * Build and maintain scalable data pipelines for BigQuery using Cloud Composer and Airflow;
 * Provide observability and monitoring using Monte Carlo and Looker as well as operational tools such as NewRelic and Splunk, driving reliability, data quality, data quality and robustness;
 * Build critical data quality checks to ensure that the data we process and provide to partner teams meets security and compliance requirements;
 * Participate in code and technical design reviews;
 * Scope and plan work together with product engineering, data science and the business; support other teams for all tasks related to data tracking, collection, ingestion, quality monitoring and alerting.


## Related Videos

- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [Our journey with Spring Boot in a microservice architecture](https://www.wearedevelopers.com/videos/511-our-journey-with-spring-boot-in-a-microservice-architecture)
- [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered)
- [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt)
- [AI Model Management Life Circles: ML Ops For Generative AI Models From Research to Deployment](https://www.wearedevelopers.com/videos/1152-ai-model-management-life-circles-ml-ops-for-generative-ai-models-from-research-to-deployment)
- [Docker build without Docker](https://www.wearedevelopers.com/videos/100114-docker-build-without-docker)

## Related Articles

- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Top-Paying Tech Jobs (with Salaries)](https://www.wearedevelopers.com/magazine/372-top-paying-tech-jobs-with-salaries)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market)