Lead Data engineer (Lead II - Software Engineering)

We're looking for a Lead Data Engineer to join our Data Team. As the most senior engineer working across a number of squads, you'll blend hands-on engineering with providing technical leadership and mentorship to data engineers. You will work closely with Product Managers, Visualisation Engineers, Data Analysts, Data Architects, and other stakeholders to deliver reliable, high-quality data products that drive strategic objectives. Additionally, you'll play a central role in championing best practices and fostering continuous improvement, actively contributing within our Agile community of practice., * Provide technical mentorship and direction to data engineers, helping to elevate team capability and maintain engineering standards, but also maximise their potential and promote career growth.

• Foster a DevOps culture of "you build it, you run it, you own it", promoting autonomy and ownership across the engineering organisation.
• Lead best practices in data engineering, code reviews, and development activities, ensuring the highest quality standards. Contributing to the Lead Engineer & Agile communities of practice. Ensuring data quality and integrity.
• Work with structured, semi-structured and structured data with varying latencies, from batch through to real-time.
• Ensure engineering solutions comply with architectural frameworks and best practices defined by Data Architects.
• Collaborate with Product Managers and Data Analysts to ensure business requirements are translated into scalable, performant data solutions.
• Evaluate and recommend new technologies and tools to enhance data engineering capabilities.
• Balance hands-on engineering responsibilities with technical leadership to drive high-quality delivery.

• Proven experience building and maintaining high-quality, secure data solutions.
• Skilled in operating scalable and high-performance applications in production environments. Prepare to be tenacious and collaborate to drive the right solutions forward.
• Have a good understanding of Microsoft Azure tooling including Azure Databricks, preferably with hands-on experience.
• Strong understanding of data modelling and architectures (e.g. data vaults, data warehousing, data lakes etc.)
• Experience with Azure based solutions such as Azure Data Factory.
• Extensive experience with languages such as Python, SQL and, preferably, PySpark.
• Version control and best practices using Github.
• Experience in working with Agile frameworks such as Scrum, Kanban, Lean.
• Excellent communication skills, with the ability to clearly explain technical concepts to non-technical business stakeholders.
• Demonstrated experience leading and mentoring data engineers.