Lead Data Engineer_ ADF & Databricks (Lead II - Software Engineering)

UST is seeking an accomplished Lead Data Engineer to join our Data Team in Leeds. This is a senior, hands-on leadership role responsible for shaping data engineering capability across multiple delivery squads. You will combine deep technical expertise with visible leadership, driving engineering excellence, mentoring talent, and delivering high-quality data products that directly support business and strategic outcomes.

This role sits at the intersection of engineering, architecture, and product, requiring close collaboration with Product Managers, Data Architects, Analysts, and Visualisation Engineers. You will also play an active role in championing best practices across our Agile and engineering communities.

The Role

• As the senior data engineering authority, you will:
• Provide technical leadership, mentorship, and career guidance to data engineers, raising engineering standards while enabling individual and team growth.
• Champion a DevOps-led culture built on ownership, accountability, and operational excellence "you build it, you run it, you own it."
• Set and uphold best practices in data engineering, including design, development, code reviews, testing, and release management.
• Actively contribute to Lead Engineer and Agile communities of practice, driving continuous improvement across teams.
• Design and deliver robust data pipelines handling structured and semi-structured data, across batch and real-time processing scenarios.
• Ensure all engineering solutions align with enterprise data architecture principles and standards defined by Data Architects.
• Partner closely with Product Managers and Data Analysts to translate business requirements into scalable, performant, and secure data solutions.
• Evaluate, influence, and adopt new technologies and tooling to strengthen data engineering capability.
• Balance hands-on engineering delivery with strategic technical leadership to ensure consistent, high-quality outcomes.

You are a senior data engineer with a strong leadership mindset and a track record of delivering at scale. You bring both technical depth and collaborative influence, and you are comfortable operating in complex, production-critical environments., * Proven experience designing, building, and operating secure, high-quality data platforms in production.

• Strong background delivering scalable, high-performance data solutions with a focus on reliability and resilience.
• Demonstrated experience mentoring and leading data engineers in Agile environments.
• Solid understanding of modern data architectures, including data lakes, data warehouses, and data vaults.
• Hands-on experience with Microsoft Azure, including services such as:

• Azure Databricks
• Azure Data Factory
• Advanced skills in Python, SQL, and ideally PySpark.

• Strong software engineering discipline, including version control and collaborative workflows using GitHub.
• Experience working within Agile frameworks such as Scrum, Kanban, or Lean.
• Excellent communication skills, with the ability to convey complex technical concepts clearly to non-technical stakeholders.

Core Skills & Technologies:

• Azure Data Factory
• Databricks
• Data integration & data flow design
• Azure-based data platforms
• Python, SQL, PySpark
• Agile delivery models

About UST UST is a global digital transformation solutions provider. For more than 20 years, UST has worked side by side with the world's best companies to make a real impact through transformation. Powered by technology, inspired by people and led by purpose, UST partners with their clients from design to operation. With deep domain expertise and a future-proof philosophy, UST embeds innovation and agility into their clients' organizations. With over 30,000 employees in 30 countries, UST builds for boundless impact-touching billions of lives in the process.