> Markdown version of [/jobs/ext/3100345-databricks-data-engineer](https://www.wearedevelopers.com/jobs/ext/3100345-databricks-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Databricks Data Engineer - **Company:** Databricks, Inc. - **Location:** London, UK - **Experience:** Expert - **Salary:** £85,000.0 - **Contract:** Permanent contract - **Skills:** Amazon Web Services, Microsoft Azure, Cloud Computing, Code Review, Data Governance, Extract Transform Load (ETL), Distributed Computing Environment, Python (Programming Language), SQL Databases, Azure Service Bus, Apache Spark, Data Lakes, Bicep, Apache Kafka, Video Streaming, Terraform, Data Pipelines, Databricks - **Published:** September 27, 2026 - **Apply:** https://www.totaljobs.com/job/data-engineer/databricks-job108049564 ## About the Role * Proven experience as a Data Engineer within production environments. * Strong hands-on experience with Databricks, Apache Spark, Delta Lake, Python, and SQL. * Experience building and supporting scalable ETL/ELT pipelines. * Strong understanding of distributed data processing and data modelling. * Cloud platform experience across Azure, AWS, or GCP. * Experience implementing data quality frameworks and pipeline monitoring. * Excellent communication and stakeholder engagement skills. Desirable Experience * Databricks certification. * Unity Catalog and Databricks Asset Bundles. * Terraform or Bicep. * dbt or similar transformation frameworks. * Kafka, Event Hubs, or other streaming technologies. * Retail, supply chain, or consumer goods industry experience. ## Description As a Senior Data Engineer, you'll be responsible for: * Building and maintaining scalable data pipelines within Databricks. * Developing and optimising batch and streaming data workflows. * Designing and implementing Lakehouse architectures and medallion data models. * Implementing data quality, monitoring, and observability frameworks. * Maintaining security, governance, and access control standards. * Collaborating with Data Scientists and Analysts to deliver business-critical data products. * Driving engineering best practice through code reviews and technical standards. * Identifying platform optimisation and cloud cost reduction opportunities. * Translating business requirements into scalable technical solutions. * Contributing to tooling decisions, documentation, and continuous improvement initiatives. ## Related Videos - [Back(end) to the Future: Embracing the continuous Evolution of Infrastructure and Code](https://www.wearedevelopers.com/videos/440-back-end-to-the-future-embracing-the-continuous-evolution-of-infrastructure-and-code) - [Infrastructure as Code: The Developer's Secret Weapon](https://www.wearedevelopers.com/videos/1221-infrastructure-as-code-the-developer-s-secret-weapon) - [Cutting LLM Costs Without Cutting Quality: How to Beat Proprietary LLMs with Fine-Tuned Open Source](https://www.wearedevelopers.com/videos/100151-cutting-llm-costs-without-cutting-quality-how-to-beat-proprietary-llms-with-fine-tuned-open-source) - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) - [OLTP in the Lakehouse: Redefining Data for AI Workloads](https://www.wearedevelopers.com/videos/2038-oltp-in-the-lakehouse-redefining-data-for-ai-workloads) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)