Data Platform Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+14 more
Job description
Event-Driven Telemetry & Behavioural Signals
- Architect the event-driven telemetry backbone capturing user interactions, system behaviours, and workflow signals across all digital platforms.
- Define consistent event schemas, taxonomies, and ACORD-aligned behavioural models.
High-Scale, High-Reliability Data Pipelines
- Build and operate batch and real-time pipelines to ingest, transform, enrich, and validate data from all digital suite products.
- Automate data quality checks, lineage capture, and SLA monitoring through modern data observability patterns.
Enterprise Feature Store Ownership
- Develop and maintain the enterprise Feature Store (Feast, Hopsworks, Databricks FS).
- Ensure features are consistent between training and inference, fully governed, and discoverable across teams.
- Manage feature versioning, contracts, embeddings, and historical point-in-time correctness.
Data Modelling, Schemas & Standards
- Implement canonical schemas aligned to industry standards (ACORD-style entities) and internal capability matrices.
- Shape unified data model powering Scope search, pricing, underwriting, claims, finance, and analytics.
Data Governance, Lineage & Metadata
- Drive end-to-end data governance: lineage, metadata cataloguing, validation frameworks, and schema evolution.
- Ensure all data is traceable, trusted, and production-grade.
ML Enablement & Historical Backtesting
- Partner with ML engineers and scientists to create ML-ready feature datasets and transformations.
- Support historical replay, time-travel datasets, and backtesting infrastructure for all digital platforms.
Cross-Platform Engineering Collaboration
- Work closely with product teams across the digital platforms to ensure smooth telemetry, consistent data flows, and scalable real-time integration patterns.
Requirements
Do you have experience in Tableau?, * Strong experience with Python, SQL, and at least one NoSQL technology.
- Hands-on depth in distributed data processing, ETL/ELT patterns, and data workflow orchestration (Airflow, dbt, ADF, Dagster).
- Solid engineering practices around testing, CI/CD, monitoring, and deployment.
- Experience with Kafka, EventHub, Kinesis, or similar distributed log technologies.
- Strong understanding of streaming schemas, consumer group strategy, watermarking, and stateful processing.
- Practical experience building or operating feature stores (Feast, Hopsworks, Databricks FS).
- Understanding of feature definitions, point-in-time joins, online/offline store separation, and feature lifecycle governance.
- Deep knowledge of canonical modelling, schema evolution, lineage systems, and metadata frameworks.
- Expertise with data services in Azure, AWS, or GCP (ADF, Glue, Dataflow, Databricks, serverless compute).
- Exposure to BI/MI tools (Power BI, Tableau).
Benefits & conditions
We are an equal opportunity employer, and we are proud to share that 93% of our employees say they can be themselves at work. We aim to hire our industry’s finest people because the best people drive the best outcomes. And we forever challenge the status quo because we know there are always ways to improve things. Because together, we’re limitless.
We value applicants from all backgrounds and foster a culture of inclusivity. We understand the need for flexibility, so work in a hybrid model. Please let us know if you require any reasonable adjustments during the recruitment process.
FCA Conduct Rules
Under the Senior Managers and Certification Regime the FCA and Aventum expects that:
- You must act with integrity.
- You must act with due skill, care and diligence.
- You must be open and cooperative with the FCA, the PRA and other regulators.
- You must pay due regard to the interests of customers and treat them fairly.
- You must observe proper standards of market conduct.
- You must act to deliver good outcomes for retail customers.
About the company
Since its inception, Aventum Group has sought a different approach to insurance. We are on a mission to be the ‘most inspiring specialty (re)insurance group in the world’.
At the heart of Aventum are our people. Working together in dynamic, service-focused teams, we prioritise our customers in everything we do. Collaboration fuels our success, courage drives our innovation and continuous improvement keeps us ahead in a rapidly evolving industry. Our shared commitment is to revolutionise insurance for the better, one day at a time.
We also believe that investing in our people is investing in our future. By empowering people across the Group to develop their careers, advance within the Group, and embrace new challenges, we build an environment where growth and learning never stop.
Our competitive benefits package, offered via a flexible benefits platform, reflects this. Beyond core benefits, employees have the freedom to tailor their benefits to meet their individual needs, supporting their unique goals and ambitions.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on indeed.comGood distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Top Big Data Technologies That You Need to Know
Data Engineer Salary UK
Highest Paying Tech Companies for Developers
Data Analyst Salary in the UK