> Markdown version of [/jobs/ext/3008105-data-engineer](https://www.wearedevelopers.com/jobs/ext/3008105-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Data Engineer

- **Company:** Step 2 Recruitment
- **Location:** London, UK
- **Experience:** Experienced
- **Salary:** £50,000.0 - £80,000.0
- **Contract:** Temporary to permanent
- **Skills:** Artificial Intelligence, Airflow, Amazon Web Services, Microsoft Azure, Cloud Computing, Directed Acyclic Graph (Directed Graphs), Data Infrastructure, Extract Transform Load (ETL), Data Security, JQuery, Python (Programming Language), Machine Learning, MySQL, NumPy, Microsoft PowerPoint, ReactJS, Backend, Pandas, Pyspark, Kubernetes, Information Technology, Codebase, Data Pipelines, Docker
- **Published:** September 20, 2026
- **Apply:** https://www.adzuna.co.uk/jobs/details/5890530755

## About the Role

* We require a strong academic background with a minimum bachelors or masters degree in a STEM subject such as Computer Science, Mathematics, or Engineering.
 * We require at least 2 years experience working as a data engineer, ideally in consulting or financial services.
 * We require proficiency in Python, including pandas and numpy.
 * We require professional experience with Azure cloud services; AWS or GCP experience is acceptable with deeper experience.
 * We require strong experience deploying clean, maintainable, production-level code.
 * We require a basic understanding of DAGs and their role in pipeline orchestration.
 * We would prefer professional experience with PySpark, MySQL, Docker, and Kubernetes.
 * We would prefer experience with best-practice pipeline orchestration software such as Airflow or Dagster.
 * We would prefer experience migrating code from prototype notebooks to .py files while maintaining logic and transparency.
 * We would prefer ownership of a project across the full software product lifecycle, from data infrastructure through model development and deployment to front-end integration.
 * We would prefer experience with pricing analytics and/or optimisation, ideally in retail banking.
 * We would prefer experience producing PowerPoint presentations or reports and presenting to clients or colleagues.
 * We would prefer an entrepreneurial spirit and a willingness to work in an early-stage start-up where impact is directly rewarded.
 * We require applicants to have the permanent right to work in the UK, as we cannot sponsor visas.

## Description

* We build, optimise, and deploy price optimisation machine learning ETL/ELT pipelines and data processes.
 * We improve and adapt our data infrastructure and code base as we scale, including collaboration, security, scalability, efficiency, automation, and auditability.
 * We interact with new clients on client pitches and work with existing clients to onboard our software, offering engineering and pricing expertise.
 * We scale our infrastructure as we take on more and larger clients.
 * We streamline and automate data refresh processes.
 * We improve our data security.
 * We build and deploy machine learning models.
 * We get involved with client pitches.
 * We travel to clients occasionally.

Technologies:

 * AI
 * Airflow
 * AWS
 * Azure
 * Cloud
 * Docker
 * ETL
 * GCP
 * Kubernetes
 * Machine Learning
 * MySQL
 * Python
 * PySpark
 * Security
 * numpy
 * pandas
 * Backend
 * React
 * jQuery


## Related Videos

- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [MySQL Protocol Features You Should Be Aware Of](https://www.wearedevelopers.com/videos/100267-mysql-protocol-features-you-should-be-aware-of)
- [Vectorize all the things! Using linear algebra and NumPy to make your Python code lightning fast.](https://www.wearedevelopers.com/videos/562-vectorize-all-the-things-using-linear-algebra-and-numpy-to-make-your-python-code-lightning-fast)
- [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered)
- [Python Data Visualization @ Deepnote (w/ PyViz overview)](https://www.wearedevelopers.com/videos/113-python-data-visualization-deepnote-w-pyviz-overview)
- [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail)

## Related Articles

- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk)
- [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market)
- [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london)
- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)
- [The 12 Best Jobs for Software Engineers](https://www.wearedevelopers.com/magazine/401-the-12-best-jobs-for-software-engineers)