Data Engineer (Databricks)

A new solution for the validation and transformation of policyholder data used in actuarial modelling and assumption setting is being built.This role will build and maintain data pipelines to take policyholder data and transform and validate it for use in actuarial models. These data systems need to be robust, reliable, efficient, and meet actuarial modelling and ass

umption setting requirements.

The Data Engineer supports the delivery of high-quality data solutions that underpin actuarial valuation and reporting, and strategic decision-making. Working collaboratively with stakeholders, the role ensures data is structured, governed, and transformed for actuarial use., * Design, build, and maintain scalable data pipelines that validate and transform data to meet actuarial modelling requirements.

• Implement checks and controls to ensure actuarial input data is complete, accurate, reconciled and available when required.
• Collaborate with stakeholders to understand data needs and translate them into effective technical solutions.
• Work with data suppliers to ensure data loads are complete and controlled.
• Work with suppliers and actuarial users to resolve data exceptions
• Monitor and optimise data performance, resolving issues and improving efficiency where needed.
• Contribute to data governance, including documentation, standards, and controls.
• Maintain runbooks or support documentation
• Works independently on well-defined deliverables and escalates material risks and issues appropriately

• Strong understanding of data structures, databases, and data modelling concepts.
• Experience working with data transformation, validation and storage processes.
• Ability to manage and process large datasets with attention to accuracy and quality.
• Familiarity with data governance and best practices in data management.
• Strong problem-solving skills and the ability to work collaboratively across teams.
• Experience working in Financial Services or a similar heavily audited environment with an understanding of operating controls and producing audit evidence
• Clear communication with both technical and non-technical stakeholders.
• Proactive approach to identifying and resolving issues.
• Commitment to continuous improvement and delivering high-quality outcomes.

Essential Skills:

• Experience working on data pipelines
• SQL
• Data management and modelling
• Desirable Skills
• Azure Databricks
• Spark
• Spark SQL
• Python/PySpark

Pulled from the full job description

• Annual leave
• Company pension
• Private medical insurance, * A valuable pension scheme of up to 18% (13% made up of employer contributions and 5% employee contributions).
• Access to our Share Save and Share Incentive Plan, alongside financial wellbeing and support services to help give you real confidence to put your money to work.
• Enjoy 38 days annual leave (including bank holidays), with the opportunity to purchase up to five extra days. Our Time Off When You Need It policy gives you the flexibility - to balance work and personal commitments.
• Our market-leading Inspiring Families policy includes comprehensive support and paid parental leave covering maternity, adoption, surrogacy, and paternity leave - because supporting families is an important part of our inclusive culture.
• Health & Protection cover includes Private Healthcare, Critical Illness cover and Life Assurance for you, with additional family options - for peace of mind.

At M&G, our purpose is to give everyone real confidence to put their money to work. With a heritage dating back more than 175 years, we have a long history of innovation in savings and investments, combining asset management and insurance expertise to offer a wide range of solutions. Our two distinct operating segments, Asset Management and Life, work together to provide access to balanced, long-term investment and savings solutions. Through telling it like it is, owning it now and moving it forward together with care and integrity; we are creating an exceptional place to work for exceptional talent. We will consider flexible working arrangements for any of our roles and offer workplace adjustments to ensure you have the support you need to succeed in your role.