> Markdown version of [/jobs/ext/3275128-data-engineer-senior-data-engineer-with-azure-databricks-and-microsoft-fabric](https://www.wearedevelopers.com/jobs/ext/3275128-data-engineer-senior-data-engineer-with-azure-databricks-and-microsoft-fabric). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer / Senior Data Engineer with Azure, Databricks and Microsoft Fabric - **Company:** DataArt - **Location:** London, UK - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Computing Platforms, Microsoft Azure, Business Systems, Code Review, Computer Programming, Information Engineering, Data Systems, Data Vault Modeling, Dimensional Modeling, Python (Programming Language), Meta-Data Management, Microsoft SQL Server, Power BI, Azure Data Lake, SQL Databases, Cloud Platform System, Azure Data Factory, GitHub Copilot, Apache Spark, Git, Microsoft Fabric, Data Lakes, Pyspark, Data Lineage, Star Schema, Data Pipelines, Server Operating Systems & Platforms, Service Stack, Legacy Systems, Databricks - **Published:** September 18, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=881db6ae222f489d ## About the Role * 6+ years of experience in Data Engineering. * Hands on experience with Azure Data Factory, Azure Databricks, and Azure Data Lake Storage Gen2. * Strong programming experience with Python, SQL, and PySpark. * Experience implementing Delta Lake and production lakehouse or medallion architectures. * Experience with Git and Azure DevOps, including CI/CD pipelines for data solutions. * Experience working with SQL Server environments. * Practical experience using AI coding assistants within software delivery projects. * Ability to communicate effectively in English with technical and business stakeholders. * Experience taking ownership of architecture or platform design decisions. * Experience reviewing code and establishing engineering standards. * Experience gathering requirements and collaborating directly with business stakeholders. * Nice to have: Experience implementing Microsoft Fabric in production environments. * Microsoft certifications including DP 203, DP 600, DP 700, AZ 900, or DP 900. * Databricks Data Engineer Associate or Databricks Data Engineer Professional certification. * Experience with dimensional modelling, including star schema, snowflake schema, or Data Vault. * Experience with semantic modelling in Power BI or Microsoft Fabric. * Knowledge of Microsoft Purview, data lineage, and metadata management. * Experience working in regulated financial services environments. ## Description Position overview: We are looking for a Senior Data Engineer with strong experience in Azure, Databricks, and Microsoft Fabric to help design and build a modern cloud data platform. You will contribute to the ingestion, transformation, and curation layers of the platform while collaborating with technical and business stakeholders. In this role, you will also support engineering standards, platform design decisions, and the delivery of scalable data solutions. Technology stack: Azure Data Factory, Azure Databricks, Microsoft Fabric, Azure Data Lake Storage Gen2, Delta Lake, Apache Spark, PySpark, Python, SQL Server, Azure DevOps, Git, Power BI, Microsoft Purview, GitHub Copilot * Responsibilities: Design and develop data ingestion pipelines from business systems into a governed cloud data platform. * Build scalable data engineering solutions using Azure Databricks and Microsoft Fabric. * Implement medallion architecture patterns and reusable engineering frameworks. * Develop curated data products and analytical datasets for business reporting and decision making. * Apply AI assisted development practices while ensuring quality, governance, and auditability. * Contribute to data modelling, semantic models, metadata management, and analytical solutions. * Support the migration of reporting and analytics workloads from legacy platforms. * Collaborate with stakeholders to translate business requirements into technical solutions. * Provide design guidance, establish engineering standards, and participate in code reviews. ## Related Videos - [Data Analytics with Microsoft Fabric: End-to-End Use Case with Data Agents](https://www.wearedevelopers.com/videos/1547-data-analytics-with-microsoft-fabric-end-to-end-use-case-with-data-agents) - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [Beyond Dashboards: Fixing Text-to-SQL with Semantic RAG](https://www.wearedevelopers.com/videos/2036-beyond-dashboards-fixing-text-to-sql-with-semantic-rag) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk) - [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market) - [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [Graph and AI Trends 2026: Why Is AI Running but Not Yet Delivering?](https://www.wearedevelopers.com/magazine/680-graph-and-ai-trends-2026-why-is-ai-running-but-not-yet-delivering)