> Markdown version of [/jobs/ext/3021460-senior-data-engineer-databricks-delta](https://www.wearedevelopers.com/jobs/ext/3021460-senior-data-engineer-databricks-delta). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Data Engineer : Databricks & Delta - **Company:** Databricks, Inc. - **Location:** London, UK - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Computer Programming, Data Architecture, Extract Transform Load (ETL), Data Structures, Performance Tuning, SQL Databases, Data Processing, Cloud Platform System, Data Ingestion, Data Lakes, Qlikview, Spark Streaming, Machine Learning Operations, Data Pipelines, Databricks - **Published:** September 21, 2026 - **Apply:** https://www.apply4u.co.uk/jobs/senior-data-engineer-databricks-delta/47839935 ## About the Role This is an exciting role for a Senior Data Engineer with strong Databricks and Delta to join a world-leading Energy Trading company. Role Description: We are looking for a highly skilledSenior Data Engineerwith strong analytical capabilities and hands-on experience in building scalable data solutions. The ideal candidate will have expertise inDatabricks,streaming architectures, data ingestion frameworks, anddashboarding, along with experience working withSAP data sources. You will be responsible for designing and implementing scalable data pipelines and enabling real-time and batch analytics across the organization. Key Responsibilities: Design and implement scalable data pipelines usingDatabricks and Delta Live Tables (DLT) Develop and managestreaming data solutionsfor real-time analytics and decision-making Ingest data from various sourcesincludingSAP systems using Qlik ReplicateandADFto ingest data from various sources ensuring data quality and consistency Performdata modellingand optimize data structures for analytics and reporting Collaborate with cross-functional teams to understand data requirements and deliver robust solutions Monitor, troubleshoot, and enhance data workflows for performance and reliability Maintain technical documentation and contribute to data engineering best practices Required Skills & Qualifications: Strong experience withDatabricks- DLT, Delta Lake concepts, UC governance Solid understanding ofstreaming technologies(e.g., Spark Structured Streaming, Autoloader) Programming skills inPython,SQL, orScala Proficiency indata modelling, ETL/ELT processes, and data architecture Experience in MS Copilot, AI Foundry , Databricks (MosiacAI, MLflow, Agentbricks, Genie) Strong analytical background with problem-solving skills Performance tuning concepts like watermarking, late data handling, parallelism & checkpointing Hands-on expertise inADF, and Qlik Replicatefor data ingestion and replication Experience working inAzure cloud environments #J-18808-Ljbffr ## Related Videos - [Fully Orchestrating Databricks from Airflow](https://www.wearedevelopers.com/videos/336-fully-orchestrating-databricks-from-airflow) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) - [Parquet, Delta, Iceberg & Ducklake - An introduction for developers](https://www.wearedevelopers.com/videos/100075-parquet-delta-iceberg-ducklake-an-introduction-for-developers) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [The Data Mesh as the end of the Datalake as we know it](https://www.wearedevelopers.com/videos/156-the-data-mesh-as-the-end-of-the-datalake-as-we-know-it) - [Cutting LLM Costs Without Cutting Quality: How to Beat Proprietary LLMs with Fine-Tuned Open Source](https://www.wearedevelopers.com/videos/100151-cutting-llm-costs-without-cutting-quality-how-to-beat-proprietary-llms-with-fine-tuned-open-source) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london)