> Markdown version of [/jobs/ext/1415291-lead-data-engineer](https://www.wearedevelopers.com/jobs/ext/1415291-lead-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Lead Data Engineer - **Company:** Acuity INC - **Location:** UK - **Experience:** Expert - **Salary:** £61,123.0 - **Contract:** Permanent contract - **Skills:** Data Analysis, Microsoft Azure, Software Quality, Code Review, Continuous Integration, Information Engineering, Data Infrastructure, Extract Transform Load (ETL), Data Systems, Database Queries, Database Security, DevOps, Graph Database, Apache Hive, Microsoft Data Access Components, Microsoft Software, Neo4j, Scrum Methodology, Query Optimization, Release Management, Azure DevOps Pipelines, SQL Stored Procedures, SQL Databases, Cloud Platform System, Azure Data Factory, GitHub Copilot, Snowflake, Microsoft Fabric, Pyspark, Data Management, Azure Synapse Analytics, Data Pipelines, Databricks - **Published:** July 24, 2026 - **Apply:** https://www.adzuna.co.uk/jobs/details/5810693516 ## About the Role Leadership & Delivery * Experience leading and mentoring Data Engineering teams. * Strong stakeholder management and communication skills. * Experience leading technical projects and Agile delivery teams. * Ability to scope technical work and define implementation approaches. * Ownership of code quality, code reviews, and engineering best practices. Data Engineering * Strong commercial experience with Microsoft Fabric, Databricks, or Azure Synapse. * Expert knowledge of PySpark and Spark SQL, with the ability to act as a technical SME for the wider engineering team. * Strong SQL skills, including query optimisation, stored procedures, and database security. * Experience building and managing ETL/ELT pipelines. * Pipeline orchestration using Azure Data Factory, Synapse Pipelines, or Microsoft Fabric. * Experience developing scalable cloud-based data platforms. Cloud & DevOps * Azure DevOps (Boards, Repositories, and CI/CD Pipelines). * Feature branching, deployment, and release management. * CI/CD best practices for modern data platforms. Nice to Have Emerging Technologies * Experience with Graph Databases (Neo4j). * Experience with Snowflake. * Experience using AI-assisted development tools such as Claude and GitHub Copilot. * Experience with Azure DevOps Pipelines. * Experience working across Microsoft data platforms including Fabric, Databricks, and Synapse. Certifications (Preferred) * Microsoft Certified: Fabric Analytics Engineer Associate. * Microsoft Certified: Fabric Data Engineer Associate. * Databricks Professional Certification. * Snowflake Certification. ## Description We are looking for an experienced Lead Data Engineer with 7+ years' commercial experience to lead the design, delivery, and continuous evolution of our modern data platform built on Microsoft technologies. This is a hands-on leadership role, combining technical expertise with people management, where you'll lead a team of Data Engineers while delivering scalable, secure, and high-performing data solutions across Databricks, Microsoft Fabric, Azure Synapse, and Azure. You'll work closely with architects, stakeholders, and delivery teams to define technical direction, establish engineering best practices, and ensure successful project delivery. This is an opportunity to play a key role in shaping our Data Engineering capability while mentoring and developing a high-performing engineering team., * Lead and mentor a team of Data Engineers, supporting their technical development and delivery. * Act as the technical SME for Data Engineering, providing guidance and support to other engineers. * Lead technical delivery across projects, defining solutions and implementation approaches. * Design, build, and optimise scalable data platforms using Microsoft Fabric, Databricks, Azure Synapse, and Azure technologies. * Develop and maintain robust data pipelines using PySpark, Spark SQL, and Azure Data Factory, Synapse, or Fabric Pipelines. * Scope technical tasks and provide accurate estimates for delivery. * Review code and establish engineering standards and best practices across the team. * Build and optimise SQL solutions, including complex queries, stored procedures, and database security. * Manage Azure DevOps Boards, Repositories, and CI/CD Pipelines throughout the development lifecycle. * Collaborate with Solution Architects, Product Owners, and stakeholders to deliver high-quality data solutions. * Drive Agile delivery, sprint planning, technical reviews, and continuous improvement initiatives. ## Related Videos - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Putting the Graph In GraphQL With The Neo4j GraphQL Library](https://www.wearedevelopers.com/videos/257-putting-the-graph-in-graphql-with-the-neo4j-graphql-library) - [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) ## Related Articles - [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk) - [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift)