BI & Databricks SME

We are recruiting a BI & Databricks SME to support a major data and regulatory programme. This is a blended data modelling, data engineering, and BI development role - but with a clear requirement for someone who is an expert in Databricks. You will act as the senior Databricks specialist within the team, ensuring best-practice modelling, engineering and transformation across multiple workstreams. You will work collaboratively with analysts, architects, product owners and business stakeholders to design data models, build pipelines, develop reporting outputs, and deliver accurate, high-quality datasets that underpin critical operational and regulatory outcomes.

What You'll Be Doing

• Leading on Databricks-based data engineering across multiple data sources.
• Designing high-quality data models, schemas, KPIs, measures and CDEs.
• Building end-to-end data pipelines using Databricks, ADF and SQL.
• Producing operational and regulatory datasets and reporting using Databricks and Power BI.
• Applying rigorous data quality and data governance standards to all development work.
• Supporting BI development activities and contributing to the wider data product suite.
• Providing guidance, coaching and SME-level direction to analysts and technical colleagues.
• Working within an Agile environment and collaborating closely with business stakeholders.

You must be able to demonstrate expert-level capability in:

• Designing and building complex Databricks notebooks, Delta pipelines and transformations.
• Optimising Databricks performance, data flows and modelling structures.
• Acting as the go-to Databricks specialist within a project or programme environment.

Technical Skills

• Advanced SQL skills including stored procedures and complex transformations.
• Strong experience with Azure Data Factory (ADF) and ETL/ELT delivery.
• Proven background in data modelling, schema design, KPI/CDE creation.
• Working knowledge of Power BI, Report Builder and broader BI tooling.
• Familiarity with Power Automate, Power Pivot, MS Teams and SharePoint.
• Understanding of Azure Data Lake and dimensional modelling.

Business & Delivery Skills

• Ability to influence, coach and work effectively with business and technical teams.
• Comfortable working with evolving requirements and ambiguity.
• Strong analytical and problem-solving abilities.
• Experience working in Agile delivery environments.

• 6 Month contract with view to extend
• £400 - 450 per day rate
• Hybrid working with 3 days on-site at Milton Keynes and 2 days working from home