Senior Data Engineer - SGI

• Design, develop, and maintain data products within an Azure Databricks lakehouse environment
• Build and optimise Silver and Gold layer transformations using Medallion Architecture principles
• Contribute to data modelling and architecture discussions
• Investigate and resolve data quality and platform issues
• Develop reporting and analytics solutions using Power BI and Databricks
• Partner with business and technical stakeholders to deliver high-quality data products
• Support code reviews, modelling reviews, and engineering best practices
• Ensure solutions are scalable, reusable, and aligned with governance standards
• Communicate technical solutions, trade-offs, and recommendations to stakeholders

By applying for this role, you consent to SGI contacting you by telephone regarding recruitment services, market updates, and relevant business opportunities

• 10+ years’ experience in Data Engineering, ideally within the insurance sector
• Proven experience delivering enterprise data platforms and business-facing data products
• Strong stakeholder management skills with the ability to work across business and technology teams
• Experience working with underwriters, actuaries, or other business stakeholders
• Strong understanding of data modelling, data governance, and Agile delivery methodologies
• Excellent communication skills with the ability to explain technical concepts to non-technical audiences
• Bachelor’s degree in a technical, scientific, mathematical, or business-related discipline (or equivalent experience)

Technical Skills

• Advanced SQL and PySpark
• Azure Databricks and Delta Lake
• Data lakehouse architectures and Medallion Architecture (Silver & Gold layers)
• Data modelling and transformation design
• Power BI reporting and dashboard development
• Databricks Dashboards
• Data quality management and troubleshooting
• Semantic layer and consumption layer development
• Azure data platform technologies
• Agile/Scrum delivery practices
• Version control and modern development workflows
• Strong understanding of data governance principles

Nice to Have

• Insurance industry experience, particularly specialty insurance, delegated authority, or large-risk environments
• Databricks Unity Catalog
• Experience with AI, LLMs, and Retrieval-Augmented Generation (RAG)
• Databricks Genie experience
• Dimensional modelling, including Star Schemas and Slowly Changing Dimensions (SCDs)
• Databricks Certified Data Engineer certification
• Microsoft Azure Data Engineer Associate certification