Lead Data Engineer - Azure & Databricks_ Nottingham, Hybrid (Lead I - Data Engineering)

We are seeking a Lead Data Engineer to play a critical role in designing and delivering enterprise-scale data platforms that power advanced analytics and business decision-making. This is an opportunity to lead from the front, shaping modern data architecture, building scalable data pipelines, and mentoring talented engineering teams within a cloud-first, data-driven environment. You will work closely with architects, data scientists, and senior stakeholders to deliver secure, high-performing data solutions aligned to strategic business outcomes. What You’ll Be Doing:

• Lead the design and delivery of scalable data platforms using Azure and Databricks
• Architect and build batch and real-time data pipelines leveraging distributed processing frameworks
• Develop and optimise ETL/ELT pipelines, data ingestion frameworks, and orchestration workflows
• Drive adoption of Lakehouse architecture, Delta Lake, and modern data modelling practices
• Implement robust data governance, quality, and performance optimisation strategies
• Collaborate with cross-functional teams to translate business needs into technical solutions
• Champion engineering excellence through code reviews, best practices, and reusable frameworks
• Mentor and guide engineers, helping to build high-performing, scalable teams
• Lead the implementation of CI/CD pipelines, DevOps practices, and Infrastructure as Code

What You’ll Bring:

• Extensive experience in data engineering and cloud-based data platform delivery
• Strong hands-on expertise with

• Databricks, PySpark, Spark SQL
• Python and/or Scala
• Real-time technologies such as Kafka / Event streaming platforms

• Deep knowledge of Microsoft Azure services, including:

• Azure Data Factory (ADF), ADLS, Synapse Analytics
• Azure Functions, Event Hub
• Proven experience designing large-scale, enterprise-grade data solutions

• Strong understanding of:

• Data warehousing, Lakehouse architecture, Delta Lake
• Data modelling, governance, and quality frameworks
• Experience with DevOps, CI/CD, and Infrastructure as Code (e.g. Azure DevOps, Git, Terraform)
• A collaborative mindset with the ability to engage and influence technical and non-technical stakeholders, data engineering,microsoft azure services,azure platform,cloud computing

UST is a global digital transformation solutions provider. For more than 20 years, UST has worked side by side with the world’s best companies to make a real impact through transformation. Powered by technology, inspired by people and led by purpose, UST partners with their clients from design to operation. With deep domain expertise and a future-proof philosophy, UST embeds innovation and agility into their clients’ organizations. With over 30,000 employees in 30 countries, UST builds for boundless impact-touching billions of lives in the process.