Data Platform Engineer

Aventum Group
London, UK
3 months ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Job source

Tech stack

Airflow Amazon Web Services Data Analysis Microsoft Azure Continuous Integration Data as a Services Data Validation Data Governance Data Infrastructure Extract Transform Load (ETL) Distributed Computing Environment Data Flow Control
+14 more
Python (Programming Language) Metadata NoSQL Power BI Backtesting SQL Databases Data Streaming Tableau (Software) Management of Software Versions Web Platforms Apache Kafka Data Pipelines Serverless Computing Databricks

Job description

Event-Driven Telemetry & Behavioural Signals

  • Architect the event-driven telemetry backbone capturing user interactions, system behaviours, and workflow signals across all digital platforms.
  • Define consistent event schemas, taxonomies, and ACORD-aligned behavioural models.

High-Scale, High-Reliability Data Pipelines

  • Build and operate batch and real-time pipelines to ingest, transform, enrich, and validate data from all digital suite products.
  • Automate data quality checks, lineage capture, and SLA monitoring through modern data observability patterns.

Enterprise Feature Store Ownership

  • Develop and maintain the enterprise Feature Store (Feast, Hopsworks, Databricks FS).
  • Ensure features are consistent between training and inference, fully governed, and discoverable across teams.
  • Manage feature versioning, contracts, embeddings, and historical point-in-time correctness.

Data Modelling, Schemas & Standards

  • Implement canonical schemas aligned to industry standards (ACORD-style entities) and internal capability matrices.
  • Shape unified data model powering Scope search, pricing, underwriting, claims, finance, and analytics.

Data Governance, Lineage & Metadata

  • Drive end-to-end data governance: lineage, metadata cataloguing, validation frameworks, and schema evolution.
  • Ensure all data is traceable, trusted, and production-grade.

ML Enablement & Historical Backtesting

  • Partner with ML engineers and scientists to create ML-ready feature datasets and transformations.
  • Support historical replay, time-travel datasets, and backtesting infrastructure for all digital platforms.

Cross-Platform Engineering Collaboration

  • Work closely with product teams across the digital platforms to ensure smooth telemetry, consistent data flows, and scalable real-time integration patterns.

Requirements

Do you have experience in Tableau?, * Strong experience with Python, SQL, and at least one NoSQL technology.

  • Hands-on depth in distributed data processing, ETL/ELT patterns, and data workflow orchestration (Airflow, dbt, ADF, Dagster).
  • Solid engineering practices around testing, CI/CD, monitoring, and deployment.
  • Experience with Kafka, EventHub, Kinesis, or similar distributed log technologies.
  • Strong understanding of streaming schemas, consumer group strategy, watermarking, and stateful processing.
  • Practical experience building or operating feature stores (Feast, Hopsworks, Databricks FS).
  • Understanding of feature definitions, point-in-time joins, online/offline store separation, and feature lifecycle governance.
  • Deep knowledge of canonical modelling, schema evolution, lineage systems, and metadata frameworks.
  • Expertise with data services in Azure, AWS, or GCP (ADF, Glue, Dataflow, Databricks, serverless compute).
  • Exposure to BI/MI tools (Power BI, Tableau).

Benefits & conditions

We are an equal opportunity employer, and we are proud to share that 93% of our employees say they can be themselves at work. We aim to hire our industry’s finest people because the best people drive the best outcomes. And we forever challenge the status quo because we know there are always ways to improve things. Because together, we’re limitless.

We value applicants from all backgrounds and foster a culture of inclusivity. We understand the need for flexibility, so work in a hybrid model. Please let us know if you require any reasonable adjustments during the recruitment process.

FCA Conduct Rules

Under the Senior Managers and Certification Regime the FCA and Aventum expects that:

  • You must act with integrity.
  • You must act with due skill, care and diligence.
  • You must be open and cooperative with the FCA, the PRA and other regulators.
  • You must pay due regard to the interests of customers and treat them fairly.
  • You must observe proper standards of market conduct.
  • You must act to deliver good outcomes for retail customers.

About the company

Since its inception, Aventum Group has sought a different approach to insurance. We are on a mission to be the ‘most inspiring specialty (re)insurance group in the world’.

At the heart of Aventum are our people. Working together in dynamic, service-focused teams, we prioritise our customers in everything we do. Collaboration fuels our success, courage drives our innovation and continuous improvement keeps us ahead in a rapidly evolving industry. Our shared commitment is to revolutionise insurance for the better, one day at a time.

We also believe that investing in our people is investing in our future. By empowering people across the Group to develop their careers, advance within the Group, and embrace new challenges, we build an environment where growth and learning never stop.

Our competitive benefits package, offered via a flexible benefits platform, reflects this. Beyond core benefits, employees have the freedom to tailor their benefits to meet their individual needs, supporting their unique goals and ambitions.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on indeed.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:15 min

Empowering domain teams with an open data platform

Sandhya Menon Sandhya Menon · World Congress 2026 Europe

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

2:37 min

Comparing traditional SQL tables versus NoSQL non-tabular databases

Stanimira Vlaeva · JS Congress

1:24 min

Moving the semantic layer upstream to avoid vendor lock-in

Piotr Menclewicz Piotr Menclewicz · Europe 2026 Virtual

1:46 min

Traditional data architecture before Microsoft Fabric

Dr. Alexander Wachtel Dr. Alexander Wachtel +1 · World Congress 2025

2:57 min

Core technical practices for robust data engineering

Sandhya Menon Sandhya Menon · World Congress 2026 Europe

Videos

See all

Related articles

See all