> Markdown version of [/jobs/ext/2842024-senior-data-engineer-microsoft-fabric-azure](https://www.wearedevelopers.com/jobs/ext/2842024-senior-data-engineer-microsoft-fabric-azure). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Data Engineer - Microsoft Fabric & Azure - **Company:** Agilisys - **Location:** London, UK - **Experience:** Expert - **Salary:** £80,125.0 - **Contract:** Permanent contract - **Skills:** Application Programming Interfaces (APIs), Artificial Intelligence, Microsoft Azure, Cloud Computing Security, Continuous Integration, Information Engineering, Extract Transform Load (ETL), Github, Python (Programming Language), Key Management, Windows PowerShell, Role-Based Access Control, Power BI, Azure Active Directory, Kusto Query Language, Runbook, Software Deployment, SQL Databases, Systems Integration, Parquet, Azure Data Factory, Sql Optimization, Delivery Pipeline, Snowflake, Apache Spark, Azure Powershell, Git, Microsoft Fabric, Pyspark, Infrastructure Automation Frameworks, Deployment Automation, Data Management, Restful APIs, Data Pipelines, Databricks - **Published:** September 11, 2026 - **Apply:** https://www.adzuna.co.uk/jobs/details/5878652989 ## About the Role You will have a strong track record of hands-on data engineering delivery, with the technical depth to work independently and the communication skills to operate confidently with technical and business stakeholders. * 5+ years' commercial data engineering experience, including experience operating at Senior Data Engineer level, with strong recent hands-on Microsoft Fabric delivery experience (ideally 18-24+ months) and demonstrable delivery of at least one production-grade Fabric implementation. * Strong Microsoft Fabric experience across OneLake, Lakehouse, Warehouse, Data Pipelines, Notebooks and Dev/Test/Production workspace patterns. * Advanced SQL, Python and PySpark, with practical experience of Delta/Parquet, medallion architecture and production-grade batch/incremental ETL/ELT. * Strong Git and CI/CD experience using Azure DevOps and/or GitHub, including controlled release, testing, deployment, rollback and environment promotion practices. * Good Azure data-platform experience, including Azure Data Factory and secure cloud/on-premises connectivity using gateway, managed private endpoint or related network patterns where required. * Working knowledge of Power BI semantic-model integration, Direct Lake/Import concepts, refresh, RLS/OLS, performance and deployment. * Practical experience of Microsoft Entra ID, RBAC, managed identities/service principals, secure engineering, data quality, testing, troubleshooting, operational documentation and runbooks. * Strong stakeholder management, mentoring and communication skills, with the ability to work in fast-moving multidisciplinary teams and contribute constructively to architecture and engineering decisions. * Experience of public-sector, local-government or other regulated environments is strongly valued. You must hold active Security Clearance or be eligible and willing to undertake BPSS/security clearance appropriate to client requirements. DESIRABLE EXPERIENCE & CERTIFICATION * Microsoft Certified: Fabric Data Engineer Associate (DP-700); DP-600 is also beneficial. * Microsoft Purview and Fabric-native governance capabilities. * Fabric Real-Time Intelligence, Eventstreams and Eventhouse/KQL. * Private Link, managed private endpoints, Azure Key Vault and gateway infrastructure. * Fabric REST APIs, PowerShell/Azure CLI, Infrastructure as Code and deployment automation. * Experience with Databricks and/or Snowflake. ## Description The Senior Data Engineer - Microsoft Fabric & Azure is a senior, hands-on role within Agilisys' Data & AI Practice. You will take engineering ownership of modern data-platform workstreams from approved design through build, testing, production deployment and handover, with Microsoft Fabric and the Azure Data Platform at the core. Working closely with architects, analysts, delivery teams and client stakeholders, you will help turn architecture into secure, scalable and supportable solutions. You will also contribute to engineering standards, mentor other engineers and help clients move from proof-of-value or legacy data platforms to production-grade services., * Deliver Fabric and Azure data platforms end to end: Build and productionise Microsoft Fabric solutions using OneLake, Lakehouses, Warehouses, Data Pipelines, Notebooks, Dataflows and Azure Data Factory, including integration with legacy, cloud and on-premises data sources. * Engineer reliable data pipelines and models: Design batch, incremental and near-real-time ETL/ELT using SQL, Python and PySpark; apply medallion, dimensional/Kimball, normalised and data-product patterns as appropriate; and use production-grade techniques such as CDC, SCD, schema-change handling, idempotency, retry/replay, backfill and source-to-target reconciliation. * Own Dev/Test/Production delivery and CI/CD: Configure Fabric workspace structures and environment-specific settings, and implement controlled promotion using Git, Azure DevOps/GitHub, Fabric Deployment Pipelines, APIs or controlled manual steps where Fabric item limitations require them. Apply branch protection, peer review, testing, approvals, rollback and release evidence. * Build for security, governance and compliance: Implement secure-by-design controls using Microsoft Entra ID, RBAC, Fabric workspace/item/data permissions, managed identities or service principals, encryption and appropriate network controls. Work with architects and governance specialists on Fabric-native governance and Microsoft Purview requirements where these are in project scope. * Optimise, monitor and troubleshoot production workloads: Tune SQL, Spark, Delta/Parquet storage, partitioning and compute for performance, cost and reliability. Establish monitoring and alerting for pipelines, notebooks, semantic-model refreshes, data freshness and Fabric capacity, and diagnose failures, data-quality issues and performance problems during delivery and hypercare. * Support Power BI and data consumption: Work effectively with data analysts for Power BI semantic models and reporting solutions, including Direct Lake and Import concepts, refresh, RLS/OLS, performance and deployment considerations, and enable governed consumption through semantic models, SQL endpoints, data products and APIs where required. * Lead engineering delivery and handover: Own assigned engineering workstreams, collaborate with stakeholders, mentor engineers, contribute to design and engineering standards, and produce clear technical documentation including implementation details, HLD/LLD contributions, operational runbooks and knowledge-transfer materials for client and support teams. ## Related Videos - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [Innovating Developer Tools with AI: Insights from GitHub Next](https://www.wearedevelopers.com/videos/1268-innovating-developer-tools-with-ai-insights-from-github-next) - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [Data Analytics with Microsoft Fabric: End-to-End Use Case with Data Agents](https://www.wearedevelopers.com/videos/1547-data-analytics-with-microsoft-fabric-end-to-end-use-case-with-data-agents) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers) - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk) - [Fullstack Developer Salary UK](https://www.wearedevelopers.com/magazine/251-fullstack-developer-salary-uk) - [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london) - [Software Engineer Salary in The UK](https://www.wearedevelopers.com/magazine/231-software-engineer-salary-in-the-uk)