Senior Data Tester

Dhetech Ltd
London, UK
3 months ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
10 years minimum
Compensation
£110,500.0 - £123,500.0
Working hours
Regular working hours
Job source

Tech stack

Automation of Tests Microsoft Azure Code Coverage Extract Transform Load (ETL) Data Warehousing Apache Hive JSON Python (Programming Language) Operational Data Store Windows PowerShell Cloud Services SQL Databases
+9 more
Data Streaming Transact-SQL Parquet Data Processing Scripting Azure Data Factory Data Lakes Pyspark Databricks

Job description

My client is an International Insurer who require an Insurance specific Data Tester, with Strong LLoyd’s of London experience OR Strong Insurance Background; Strong Data reconciliation, data warehousing Testing background and Azure Data Bricks, Spark SQL. pySpark., * Own end-to-end data testing for financial reconciliation pipelines across Lloyd’s insurance datasets (premium/claims/ledger movements).

  • Perform manual and exploratory data testing: deep dive investigations, anomaly detection, root cause analysis and triage.
  • Design and execute reconciliation test strategies (control totals, balancing checks, completeness, accuracy, timeliness, and lineage).
  • Validate ETL/ELT transformations in Databricks using PySpark + Spark SQL; verify joins, aggregations, currency conversions, and business rules.
  • Build and maintain semi-automated test assets: reusable SQL/PySpark validation scripts, data comparison utilities, parameterized checks, and regression packs.
  • Ensure test coverage for edge cases: late arriving data, duplicates, reversals, adjustments, cancellations, and back-dated movements.
  • Hands-on Databricks and Azure ecosystem experience; proficiency in PySpark and Spark SQL for validation.
  • Experience with Azure data services and cloud data platforms (eg, ADLS, Azure Data Factory, Synapse/Databricks patterns).

Lloyd’s Insurance Domain Knowledge Mandatory

  • Familiarity with Lloyd’s market constructs and insurance data concepts such as syndicates, brokers, coverholders, bordereaux, and premium/claims lifecycle.
  • Exposure to currency handling, multi-ledger scenarios, settlement cycles, and financial movement types (paid, outstanding, incurred, reserves).
  • Understanding of policy/claim identifiers, endorsements, adjustments, and how they affect reconciliation.

Tools & Technologies

  • Azure (ADLS, ADF, Azure DevOps desirable), Databricks, PySpark, Spark SQL, Python, SQL (T-SQL/ANSI), Scripting (Shell/PowerShell desirable)
  • Data formats: Parquet/Delta, CSV, JSON; exposure to Delta Lake concepts beneficial

Pay: £425.00-£475.00 per day

Requirements

Do you have experience in SQL?, We are seeking a Senior, experienced Data Tester with 10+ years of experience, to lead and execute data quality and reconciliation testing across Lloyd’s of London insurance data flows. The role combines strong manual testing and analytical investigation with semi-automated validation using Azure, Databricks, PySpark, Spark SQL, and scripting. You will validate financial and operational data across ingestion, transformation, and reporting layers, ensuring accuracy of premium, claims, settlements, bordereaux, ledgers, and reconciliation outputs.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on indeed.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:47 min

Exploring JSON, CBOR, and JOSE for data serialization

Aaron Russell · LIVE

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

2:50 min

How Parquet metadata enables efficient data reading

Matthias Niehoff Matthias Niehoff · WWC Europe 2026

6:08 min

Applying software engineering environments and testing to data pipelines

Matthias Niehoff Matthias Niehoff · WWC 2024

2:03 min

Distinguishing type definition constructs from data validation routines

Clemens Vasters Clemens Vasters · WWC 2025

4:59 min

Bringing DevOps practices to data transformation with DBT

Matthias Niehoff Matthias Niehoff · WWC 2024

Videos

See all

Related articles

See all