> Markdown version of [/jobs/ext/3008126-senior-data-engineer](https://www.wearedevelopers.com/jobs/ext/3008126-senior-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Data Engineer - **Company:** Hireful - **Location:** London, UK (Remote available) - **Experience:** Expert - **Salary:** £75,000.0 - £85,000.0 - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Amazon Web Services, Cloud Computing, Continuous Integration, Data Architecture, Information Engineering, Extract Transform Load (ETL), Apache Hive, Python (Programming Language), Standard Sql, Sql Optimization, Apache Spark, Data Lakes, Pyspark, Software Version Control, Data Pipelines, Databricks - **Published:** September 20, 2026 - **Apply:** https://www.adzuna.co.uk/jobs/details/5890529664 ## About the Role * Senior-level experience in data engineering with strong hands-on Databricks skills, including PySpark, Spark SQL, and Delta Lake * Advanced SQL and Python coding skills * Track record of building and optimising enterprise-scale data pipelines and ETL/ELT solutions * Solid grounding in data architecture, modelling, and modern data platform design * Cloud experience, preferably AWS * Familiarity with CI/CD and source control best practice * Desirable: data science-leaning background or interest in exploring ML/AI and data/predictive modelling strategies ## Description * Design, build, and maintain scalable data pipelines and data products using Databricks, PySpark, Spark SQL, and Delta Lake * Develop and optimise ETL/ELT processes to ingest, transform, and curate data from internal and external systems * Shape enterprise data architecture, balancing scalability, performance, security, and maintainability * Partner with stakeholders across Finance, Product, Sales, Marketing, and Engineering to turn business challenges into technical solutions * Embed data quality, governance, and access controls throughout the data lifecycle * Mentor a junior engineer and help mature a growing data function Technologies: * AI * AWS * CI/CD * Cloud * Databricks * ETL * Marketing * Python * PySpark * SQL * Security * Spark ## Related Videos - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Cutting LLM Costs Without Cutting Quality: How to Beat Proprietary LLMs with Fine-Tuned Open Source](https://www.wearedevelopers.com/videos/100151-cutting-llm-costs-without-cutting-quality-how-to-beat-proprietary-llms-with-fine-tuned-open-source) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) - [OLTP in the Lakehouse: Redefining Data for AI Workloads](https://www.wearedevelopers.com/videos/2038-oltp-in-the-lakehouse-redefining-data-for-ai-workloads) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk) - [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Fully Remote Software Engineer Jobs](https://www.wearedevelopers.com/magazine/447-fully-remote-software-engineer-jobs)