> Markdown version of [/jobs/ext/1376004-data-engineer-databricks](https://www.wearedevelopers.com/jobs/ext/1376004-data-engineer-databricks). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Data Engineer (Databricks)

- **Company:** M&G
- **Location:** Stirling, UK
- **Contract:** Permanent contract
- **Skills:** Big Data, Databases, Data Governance, Data Transformation, Data Structures, Data Systems, Apache Hive, Python (Programming Language), Standard Sql, Apache Spark, Pyspark, Data Management, Data Pipelines, Databricks
- **Published:** July 22, 2026
- **Apply:** https://uk.indeed.com/viewjob?jk=320928ecb84c1aff

## About the Role

* Strong understanding of data structures, databases, and data modelling concepts.
 * Experience working with data transformation, validation and storage processes.
 * Ability to manage and process large datasets with attention to accuracy and quality.
 * Familiarity with data governance and best practices in data management.
 * Strong problem-solving skills and the ability to work collaboratively across teams.
 * Experience working in Financial Services or a similar heavily audited environment with an understanding of operating controls and producing audit evidence
 * Clear communication with both technical and non-technical stakeholders.
 * Proactive approach to identifying and resolving issues.
 * Commitment to continuous improvement and delivering high-quality outcomes.

Essential Skills:

 * Experience working on data pipelines
 * SQL
 * Data management and modelling
 * Desirable Skills
 * Azure Databricks
 * Spark
 * Spark SQL
 * Python/PySpark

## Description

A new solution for the validation and transformation of policyholder data used in actuarial modelling and assumption setting is being built.This role will build and maintain data pipelines to take policyholder data and transform and validate it for use in actuarial models. These data systems need to be robust, reliable, efficient, and meet actuarial modelling and ass

umption setting requirements.

The Data Engineer supports the delivery of high-quality data solutions that underpin actuarial valuation and reporting, and strategic decision-making. Working collaboratively with stakeholders, the role ensures data is structured, governed, and transformed for actuarial use., * Design, build, and maintain scalable data pipelines that validate and transform data to meet actuarial modelling requirements.

 * Implement checks and controls to ensure actuarial input data is complete, accurate, reconciled and available when required.
 * Collaborate with stakeholders to understand data needs and translate them into effective technical solutions.
 * Work with data suppliers to ensure data loads are complete and controlled.
 * Work with suppliers and actuarial users to resolve data exceptions
 * Monitor and optimise data performance, resolving issues and improving efficiency where needed.
 * Contribute to data governance, including documentation, standards, and controls.
 * Maintain runbooks or support documentation
 * Works independently on well-defined deliverables and escalates material risks and issues appropriately


## Related Videos

- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology)
- [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt)
- [Kubernetes and Microservices with Multi-Model Databases](https://www.wearedevelopers.com/videos/382-kubernetes-and-microservices-with-multi-model-databases)
- [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail)
- [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning)

## Related Articles

- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk)
- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Fullstack Developer Salary UK](https://www.wearedevelopers.com/magazine/251-fullstack-developer-salary-uk)
- [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production)
- [Software Engineer Salary in The UK](https://www.wearedevelopers.com/magazine/231-software-engineer-salary-in-the-uk)