> Markdown version of [/jobs/ext/2022398-senior-data-engineer](https://www.wearedevelopers.com/jobs/ext/2022398-senior-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Data Engineer - **Company:** Dufrain Consulting - **Location:** London, UK - **Experience:** Expert - **Salary:** £71,967.0 - **Contract:** Permanent contract - **Skills:** Data Analysis, Application Frameworks, Unit Testing, Microsoft Azure, Code Review, Continuous Integration, Data as a Services, Information Engineering, Data Systems, DevOps, Python (Programming Language), PostgreSQL, Microsoft SQL Server, Object-Oriented Software Development, Standard Sql, SQL Databases, SQL Server Integration Services, Data Streaming, Azure Service Bus, Git, Microsoft Fabric, Data Lakes, Pyspark, Bicep, Data Management, Restful APIs, Terraform, Data Pipelines, Databricks - **Published:** August 11, 2026 - **Apply:** https://www.adzuna.co.uk/jobs/details/5836339616 ## About the Role * The drive to meet tight deadlines and maintain high standards of delivery * Confidence participating effectively in meetings with senior stakeholders * A collaborative mindset-supporting, encouraging, and sharing knowledge across the team * Self-starter habits; you work well under pressure with limited supervision * A track record of accurate output and ownership of elements of project delivery * Flexibility to work as part of an integrated team or independently as needed * Awareness of relevant industry standards, regulations, and current developments Essential Technical skills and experience: * Strong experience designing and delivering data solutions on Azure * Broad data engineering skillset, with depth in either Microsoft Fabric or Databricks and a working understanding of the other * Strong Python and PySpark, including object-oriented design, building reusable libraries and packages, and unit testing, alongside strong SQL * Experience building and maintaining metadata-driven or parameterised pipelines rather than hand-built one-per-source solutions * Solid grasp of lakehouse and medallion architecture, dimensional modelling including SCD Type 2, and incremental load patterns (watermarking, CDC, idempotent and restartable pipelines) * Practical data quality and schema drift handling, including validation rules and quarantine and reprocessing patterns * Engineering delivery discipline: Git branching and code review, CI/CD for data pipelines (Azure DevOps), environment promotion and testing, with awareness of Terraform or Bicep, * Hands-on Databricks components: Delta Lake, Unity Catalog, Workflows, LakeFlow (Connect and Declarative Pipelines), Databricks Asset Bundles * Hands-on Fabric engineering: pipelines, notebooks, environments, and deployment via DevOps or fabric-cicd * Breadth of source connectivity: REST APIs, SQL Server, PostgreSQL, file-based sources, and streaming via Event Hubs * Experience contributing to reusable frameworks, accelerators, or internal libraries distributed as packages * Migration experience from legacy estates (SSIS, Synapse, on-prem SQL) into modern lakehouse platforms * Experience with Purview, or equivalent catalogue and lineage tooling Desirable Certifications * Databricks Certified Data Engineer Associate * Databricks Certified Data Engineer Professional * Microsoft Certified: Fabric Analytics Engineer Associate (DP-600) * Microsoft Certified: Fabric Data Engineer Associate (DP-700) ## Description Data engineering is the heartbeat of every modern data platform, our engineers create the foundations that help clients unlock the full value of their data. ResponsibilitiesYou're a driven, proactive experienced Data Engineer who thrives in fast-paced environments and consistently delivers accurate, reliable solutions. You communicate with clarity, contribute confidently in meetings with senior stakeholders, and take ownership of your part in project delivery. Equally comfortable working independently or within an integrated squad, you support and share knowledge with others, stay current with industry standards, and meet tight deadlines while maintaining high engineering quality., RequirementsOur Data Engineers play a pivotal role in supporting clients as they navigate the complexities of data management, analytics, and strategy. Responsibilities include but are not limited to; * Develop good working relationships with clients on a project including interpersonal skills with both business and technical focused colleagues. * Experience working as a data engineer to develop performant end-to-end solutions in a collaborative team environment. * Delivering high-quality pieces of work, proven ability to escalate problems to client / senior team members where necessary and propose possible solutions. * Support building the Consulting practice through contribution to ongoing initiatives. This can include contributing to knowledge-sharing activities, and data services. ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform) - [Back(end) to the Future: Embracing the continuous Evolution of Infrastructure and Code](https://www.wearedevelopers.com/videos/440-back-end-to-the-future-embracing-the-continuous-evolution-of-infrastructure-and-code) - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering) - [DevOps Maturity Check – a way to balance autonomy and alignment](https://www.wearedevelopers.com/videos/58-devops-maturity-check-a-way-to-balance-autonomy-and-alignment) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers) - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london) - [Fullstack Developer Salary UK](https://www.wearedevelopers.com/magazine/251-fullstack-developer-salary-uk)