> Markdown version of [/jobs/ext/4535872-senior-data-engineer-sgi](https://www.wearedevelopers.com/jobs/ext/4535872-senior-data-engineer-sgi). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Senior Data Engineer - SGI

- **Company:** The Source
- **Location:** London, UK
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Agile Methodology, Artificial Intelligence, Business Analytics Applications, Computing Platforms, Microsoft Azure, Code Review, Information Engineering, Data Governance, Dimensional Modeling, Power BI, Enterprise Data Management, Azure Data Factory, Sql Optimization, Large Language Models, Generative AI, Data Lakes, Pyspark, Data Lakehouse, Software Version Control, Databricks
- **Published:** November 3, 2026
- **Apply:** https://www.reed.co.uk/jobs/senior-data-engineer-sgi/57515458

## About the Role

* 10+ years' experience in Data Engineering, ideally within the insurance sector
 * Proven experience delivering enterprise data platforms and business-facing data products
 * Strong stakeholder management skills with the ability to work across business and technology teams
 * Experience working with underwriters, actuaries, or other business stakeholders
 * Strong understanding of data modelling, data governance, and Agile delivery methodologies
 * Excellent communication skills with the ability to explain technical concepts to non-technical audiences
 * Bachelor's degree in a technical, scientific, mathematical, or business-related discipline (or equivalent experience)

Technical Skills

 * Advanced SQL and PySpark
 * Azure Databricks and Delta Lake
 * Data lakehouse architectures and Medallion Architecture (Silver & Gold layers)
 * Data modelling and transformation design
 * Power BI reporting and dashboard development
 * Databricks Dashboards
 * Data quality management and troubleshooting
 * Semantic layer and consumption layer development
 * Azure data platform technologies
 * Agile/Scrum delivery practices
 * Version control and modern development workflows
 * Strong understanding of data governance principles

Nice to Have

 * Insurance industry experience, particularly specialty insurance, delegated authority, or large-risk environments
 * Databricks Unity Catalog
 * Experience with AI, LLMs, and Retrieval-Augmented Generation (RAG)
 * Databricks Genie experience
 * Dimensional modelling, including Star Schemas and Slowly Changing Dimensions (SCDs)
 * Databricks Certified Data Engineer certification
 * Microsoft Azure Data Engineer Associate certification

## Description

* Design, develop, and maintain data products within an Azure Databricks lakehouse environment
 * Build and optimise Silver and Gold layer transformations using Medallion Architecture principles
 * Contribute to data modelling and architecture discussions
 * Investigate and resolve data quality and platform issues
 * Develop reporting and analytics solutions using Power BI and Databricks
 * Partner with business and technical stakeholders to deliver high-quality data products
 * Support code reviews, modelling reviews, and engineering best practices
 * Ensure solutions are scalable, reusable, and aligned with governance standards
 * Communicate technical solutions, trade-offs, and recommendations to stakeholders

By applying for this role, you consent to SGI contacting you by telephone regarding recruitment services, market updates, and relevant business opportunities