> Markdown version of [/jobs/ext/2306707-data-engineer](https://www.wearedevelopers.com/jobs/ext/2306707-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Data Engineer

- **Company:** SearchWorks
- **Location:** Greater London, UK
- **Contract:** Permanent contract
- **Skills:** Application Programming Interfaces (APIs), Airflow, Amazon Web Services, Data Analysis, Microsoft Azure, Continuous Integration, Data Architecture, Information Engineering, Data Integration, Extract Transform Load (ETL), Data Warehousing, Database Design, Django Web Framework, Python (Programming Language), Tensorflow, DataOps, SQL Databases, Management of Software Versions, Web Applications, Data Storage Technologies, Apache Spark, Backend, Data Lakes, Deployment Automation, Terraform, Data Pipelines
- **Published:** August 30, 2026
- **Apply:** https://www.collegerecruiter.com/job/2815448997-data-engineer

## About the Role

* Strong problem-solving skills, shown through academic or professional work.
 * Solid foundations in data architecture, data engineering best practices and scalable data solutions.
 * Good understanding of data modelling, database design and normalisation.
 * Proficiency in Python and SQL, ideally with experience of frameworks such as Airflow, TensorFlow or Spark.
 * Willingness to build basic-intermediate backend skills (e.g. Python/Django) to support data integrations.
 * Familiarity with data versioning, data quality management, build/deployment automation and CI/CD., * Experience building and maintaining data pipelines in production.
 * Exposure to data lakes, data warehousing and modern data storage patterns.
 * Experience with cloud platforms (AWS/Azure) and tools like Apache Airflow, Terraform or SageMaker.

## Description

You'll combine data engineering, analytics, visualisation and infrastructure to make high-quality data accessible across the business., * Build and maintain scalable data pipelines feeding mobile and web apps, plus internal dashboards.

 * Design and implement data architecture to optimise storage, retrieval and processing.
 * Develop ETL processes to ingest, transform and load data from multiple sources, especially APIs.
 * Work closely with data scientists and software engineers to understand data needs for product features.
 * Partner with operations and commercial stakeholders to shape data requirements for reporting and decision-making.
 * Create and maintain data documentation, monitor pipeline performance and troubleshoot issues.


## Related Videos

- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [Developing the Backend with Stefan Lingler, CTO at Shpock](https://www.wearedevelopers.com/videos/100360-developing-the-backend-with-stefan-lingler-cto-at-shpock)
- [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt)
- [AI Model Management Life Circles: ML Ops For Generative AI Models From Research to Deployment](https://www.wearedevelopers.com/videos/1152-ai-model-management-life-circles-ml-ops-for-generative-ai-models-from-research-to-deployment)
- [Nest.js - TypeScript in the backend can also be clean](https://www.wearedevelopers.com/videos/1033-nest-js-typescript-in-the-backend-can-also-be-clean)
- [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering)

## Related Articles

- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market)
- [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london)
- [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk)
- [Top-Paying Tech Jobs (with Salaries)](https://www.wearedevelopers.com/magazine/372-top-paying-tech-jobs-with-salaries)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)