Lead Data Engineer

You'll play a proactive role in the delivery of next-generation data platforms, will manage / mentor the existing person and drive the design, development and governance of the data pipelines. You'll be working really closely with stakeholders across the technology function and within the business and will the availability, integrity and compliance of the systems. You'll play a key role in the ownership of the core architecture / engineering across the new Azure Databricks ecosystem.

You'll ensure that the data platform architecture supports availability and growth targets and that the platforms leverage advances in AI and Machine Learning capability.

They are currently working with a 3rd Party Data Partner who have recommended a number of improvements - you'll work closely with them selecting, implementing and managing technology so it's a great opportunity to really make a difference.

Key to this is proactivity - they're really looking for someone who is always looking at "what's next" - are there new tools or functionality that will help the business move forward. Other key background / attributes include:

• In depth experience of modern data solution architecture design and delivery in a hybrid cloud environment but predominantly Azure / Databricks
• Experience of pipeline orchestration management
• Strong exprerience with Databricks
• Experience of implementing machine learning and AI
• Tooling such as Purview and Unity Catalog as well as the use of observability tools such as Monte Carlo, Fabric Monitoring and Log Analytics
• Mentoring / Leading / Management experience initially with a small team but with a view that this will grow
• Ideally skills in Delta Live Tables, Kafka, Azure Stream Analytics, Azure ML, PowerBI and Financial Modelling experience.