Lead Data Engineer

We are seeking a Lead Data Engineer to join a forward-thinking organisation that is transforming its data landscape. You will be the technical lead on the migration of the company's existing Azure Data Platform to Databricks where you will be responsible for the build of the new platform before overseeing the decommissioning of legacy systems.

This is a hands-on engineering role where you will also wear multiple hats including managing more junior Data Engineers, setting the standard for best practices and influencing the organisation's data strategy. Longer term, you'll help integrate AI and advanced analytics into the data ecosystem.

Responsibilities

• Lead and mentor a team of Data Engineers, fostering collaboration and technical excellence.
• Act as technical lead for the migration from Azure to Databricks.
• Architect and implement robust, cloud-first data solutions.
• Build and optimise high-performance data pipelines and ETL processes.

• Proven experience as a Senior or Lead Data Engineer.
• Strong hands-on expertise with Databricks and PySpark/Spark SQL.
• Deep knowledge of the Azure data platform (Data Factory, Synapse, etc.).
• Solid understanding of data architecture principles and performance optimisation.
• Experience managing or mentoring junior engineers.

• Salary up to 75,000.
• Hybrid working - one day per week in the office.
• 25 days holiday plus bank holidays.
• Opportunity to work on enterprise-scale projects and shape data strategy.
• Professional development and clear career progression.

Tenth Revolution Group are the go-to recruiter for Data & AI roles in the UK offering more opportunities across the country than any other recruitment agency. We're the proud sponsor and supporter of SQLBits, Power Platform World Tour, and the London Fabric User Group.