> Markdown version of [/jobs/ext/2856573-senior-data-engineer-databricks](https://www.wearedevelopers.com/jobs/ext/2856573-senior-data-engineer-databricks). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Senior Data Engineer - Databricks

- **Company:** ecruit
- **Location:** Nottingham, UK (Remote available)
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Amazon Web Services, Microsoft Azure, Cloud Computing, Continuous Integration, Information Engineering, Extract Transform Load (ETL), Data Transformation, Data Warehousing, Python (Programming Language), Standard Sql, SQL Databases, Apache Spark, Software Troubleshooting, Data Lakes, Pyspark, Information Technology, Machine Learning Operations, Terraform, Data Pipelines, Databricks
- **Published:** September 12, 2026
- **Apply:** https://www.totaljobs.com/job/senior-data-engineer-databricks/ecruit-job107971372

## About the Role

Are you an experienced Data Engineer who enjoys turning complex data into reliable, scalable solutions? Do you have strong hands-on experience with Databricks, PySpark, Python and SQL?, * 5+ years' Data Engineering experience.

 * Strong hands-on Databricks, PySpark, Python and SQL skills.
 * Experience building and optimising ETL/ELT data pipelines.
 * Knowledge of Delta Lake and data warehousing.
 * Experience with at least one of AWS, Azure or GCP.
 * Strong troubleshooting and problem-solving skills.
 * A Computer Science or related technical background.
 * Experience with Unity Catalog, MLflow, CI/CD, Terraform or Databricks certification would be a bonus.

## Description

You'll build and improve data pipelines that solve real business problems, working with modern Databricks and cloud technologies. Alongside hands-on development, you'll troubleshoot issues, improve performance and work closely with engineers, analysts, data scientists and technical leads., You will:

 * Build scalable pipelines using Databricks, Spark and PySpark.
 * Develop ETL/ELT and data transformation workflows using Python and SQL.
 * Create and maintain Databricks notebooks, jobs, workflows and clusters.
 * Work with Delta Lake and lakehouse architectures.
 * Monitor, troubleshoot and optimise pipeline performance.
 * Maintain high standards of data quality and reliability.
 * Work across AWS, Azure or GCP environments.
 * Automate processes and create reusable engineering solutions.
 * Support and mentor junior Data Engineers.


## Related Videos

- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [Infrastructure as Code: The Developer's Secret Weapon](https://www.wearedevelopers.com/videos/1221-infrastructure-as-code-the-developer-s-secret-weapon)
- [Cutting LLM Costs Without Cutting Quality: How to Beat Proprietary LLMs with Fine-Tuned Open Source](https://www.wearedevelopers.com/videos/100151-cutting-llm-costs-without-cutting-quality-how-to-beat-proprietary-llms-with-fine-tuned-open-source)
- [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail)
- [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning)

## Related Articles

- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk)
- [Where To Find Software Engineering Jobs](https://www.wearedevelopers.com/magazine/396-where-to-find-software-engineering-jobs)
- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london)
- [Software Engineer Salary in The UK](https://www.wearedevelopers.com/magazine/231-software-engineer-salary-in-the-uk)