> Markdown version of [/jobs/ext/344517-lead-data-engineer-azure-databricks_-nottingham-hybrid-lead-i-data-engineering](https://www.wearedevelopers.com/jobs/ext/344517-lead-data-engineer-azure-databricks_-nottingham-hybrid-lead-i-data-engineering). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Lead Data Engineer - Azure & Databricks_ Nottingham, Hybrid (Lead I - Data Engineering) - **Company:** Ust View All - **Location:** Nottingham, UK - **Experience:** Expert - **Contract:** Temporary contract - **Skills:** Microsoft Azure, Cloud Database, Code Review, Continuous Integration, Data Architecture, Information Engineering, Data Governance, Extract Transform Load (ETL), Data Systems, Data Warehousing, DevOps, Apache Hive, Python (Programming Language), Data Streaming, Data Ingestion, Azure Data Factory, Git, Data Lakes, Pyspark, Infrastructure Automation Frameworks, Data Analytics, Apache Kafka, Data Management, Terraform, Data Pipelines, Serverless Computing, Databricks - **Published:** June 13, 2026 - **Apply:** https://www.careerjet.co.uk/jobad/gbfb42d0053ec68ebc40fc394d87392c5c ## About the Role * Databricks, PySpark, Spark SQL * Python and/or Scala * Real-time technologies such as Kafka / Event streaming platforms * Deep knowledge of Microsoft Azure services, including: * Azure Data Factory (ADF), ADLS, Synapse Analytics * Azure Functions, Event Hub * Proven experience designing large-scale, enterprise-grade data solutions * Strong understanding of: * Data warehousing, Lakehouse architecture, Delta Lake * Data modelling, governance, and quality frameworks * Experience with DevOps, CI/CD, and Infrastructure as Code (e.g. Azure DevOps, Git, Terraform) * A collaborative mindset with the ability to engage and influence technical and non-technical stakeholders, data engineering,microsoft azure services,azure platform,cloud computing ## Description We are seeking a Lead Data Engineer to play a critical role in designing and delivering enterprise-scale data platforms that power advanced analytics and business decision-making. This is an opportunity to lead from the front, shaping modern data architecture, building scalable data pipelines, and mentoring talented engineering teams within a cloud-first, data-driven environment. You will work closely with architects, data scientists, and senior stakeholders to deliver secure, high-performing data solutions aligned to strategic business outcomes. What You'll Be Doing: * Lead the design and delivery of scalable data platforms using Azure and Databricks * Architect and build batch and real-time data pipelines leveraging distributed processing frameworks * Develop and optimise ETL/ELT pipelines, data ingestion frameworks, and orchestration workflows * Drive adoption of Lakehouse architecture, Delta Lake, and modern data modelling practices * Implement robust data governance, quality, and performance optimisation strategies * Collaborate with cross-functional teams to translate business needs into technical solutions * Champion engineering excellence through code reviews, best practices, and reusable frameworks * Mentor and guide engineers, helping to build high-performing, scalable teams * Lead the implementation of CI/CD pipelines, DevOps practices, and Infrastructure as Code What You'll Bring: * Extensive experience in data engineering and cloud-based data platform delivery * Strong hands-on expertise with ## Related Videos - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform) - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers) - [Fullstack Developer Salary UK](https://www.wearedevelopers.com/magazine/251-fullstack-developer-salary-uk)