> Markdown version of [/jobs/ext/2207997-senior-data-engineer](https://www.wearedevelopers.com/jobs/ext/2207997-senior-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Data Engineer - **Company:** FBI &TMT - **Location:** Kingston upon Thames, UK (Remote available) - **Experience:** Expert - **Salary:** £65,000.0 - **Contract:** Permanent contract - **Skills:** Amazon Web Services, Microsoft Azure, Code Review, Data Validation, Information Engineering, Extract Transform Load (ETL), Database Queries, Distributed Computing Environment, Monitoring of Systems, Python (Programming Language), Azure Data Lake, Azure Service Bus, Cloud Platform System, Azure Data Factory, Apache Spark, Data Lakes, Information Technology, Bicep, Apache Kafka, Video Streaming, Terraform, Data Pipelines, Databricks - **Published:** August 24, 2026 - **Apply:** https://www.totaljobs.com/job/senior-data-engineer/fbi-tmt-job107889874 ## About the Role * Strong experience delivering production grade Databricks pipelines * Strong Spark, Delta Lake and Databricks Workflows experience * Python and SQL proficiency * Experience on Azure data platforms such as Azure Data Factory, ADLS Gen2, Azure DevOps, or equivalent on AWS or GCP * Understanding of data modelling, ETL and ELT patterns, distributed processing * Experience implementing data quality checks and pipeline monitoring * Strong communication and stakeholder management Desirable * Databricks certification * Unity Catalog and Databricks Asset Bundles * Terraform or Bicep * dbt or similar transformation frameworks * Retail or CPG data exposure such as POS, inventory, supply chain * Streaming technologies such as Kafka or Event Hubs Education * Degree in computer science, data engineering or related field, or equivalent practical experience ## Description We are looking for a Senior Data Engineer to join the Retail Insight Data and Engineering team, contributing to the design, development and day to day operation of our Databricks environment. You will build reliable, scalable pipelines and help shape engineering standards, working closely with the Lead Data Engineer and partnering with data science, analytics and product teams., * Build and maintain scalable data pipelines using Databricks, Apache Spark and Delta Lake * Develop and optimise batch and streaming workflows for reliability and performance * Contribute to lakehouse architecture and medallion pattern implementation * Implement data quality checks, monitoring and observability across pipelines * Apply platform security, access control and governance standards * Support code reviews and high engineering quality standards * Identify cloud cost optimisation opportunities * Translate business requirements into technical solutions * Contribute to documentation and continuous improvement ## Related Videos - [Back(end) to the Future: Embracing the continuous Evolution of Infrastructure and Code](https://www.wearedevelopers.com/videos/440-back-end-to-the-future-embracing-the-continuous-evolution-of-infrastructure-and-code) - [Infrastructure as Code: The Developer's Secret Weapon](https://www.wearedevelopers.com/videos/1221-infrastructure-as-code-the-developer-s-secret-weapon) - [Cutting LLM Costs Without Cutting Quality: How to Beat Proprietary LLMs with Fine-Tuned Open Source](https://www.wearedevelopers.com/videos/100151-cutting-llm-costs-without-cutting-quality-how-to-beat-proprietary-llms-with-fine-tuned-open-source) - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) - [OLTP in the Lakehouse: Redefining Data for AI Workloads](https://www.wearedevelopers.com/videos/2038-oltp-in-the-lakehouse-redefining-data-for-ai-workloads) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)