Senior Data Quality Engineer

gb Develop
London, UK
18 days ago
Apply on www.totaljobs.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Compensation
£85,000.0
Working hours
Regular working hours

Tech stack

Geographic Information Systems Airflow Big Data BigQuery Web Scraping Data Integrity Python (Programming Language) Node.Js PostGIS Standard Sql SQL Databases TypeScript
+4 more
Kubernetes Geospatial Data Abstraction Library (GDAL) Playwright Docker

Job description

You will:

  • Design and develop data quality checks covering validation, anomaly detection, freshness and coverage.
  • Own and improve production web-scraping infrastructure, including Playwright, proxies and anti-bot handling.
  • Build and maintain data orchestration workflows using Dagster or similar.
  • Develop internal QA and investigation tools to improve how data issues are identified and resolved.
  • Use Python, SQL, dbt and BigQuery to diagnose root causes and improve data reliability.
  • Work with TypeScript/Node.js where required.
  • Partner with data and engineering teams to continuously raise the quality bar.
  • Use AI-assisted development tools to build and ship solutions efficiently.

Requirements

  • Strong Python and SQL skills, with hands-on dbt and BigQuery experience.
  • Proven experience designing data quality, validation and anomaly detection processes.
  • Production experience with web scraping at scale, ideally using Playwright or an equivalent.
  • Experience with big data sets and big data warehouses
  • Experience with proxies, anti-bot measures and scraper monitoring.
  • Experience with Dagster, Airflow, Prefect or another data orchestrator.
  • Comfort working with TypeScript/Node.js.
  • A pragmatic, hands-on approach and strong problem-solving skills.

Desirable:

  • Geospatial data experience (PostGIS, GeoPandas, GDAL), GCP/Kubernetes/Docker experience
  • Knowledge of the UK property/planning sector.

Benefits & conditions

  • 37 days’ annual leave, including birthday and Christmas shutdown
  • Hybrid working and home-working equipment
  • £500 annual learning and development budget
  • Private healthcare
  • Salary-sacrifice pension scheme
  • Regular team events and monthly team lunches

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.totaljobs.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:15 min

Empowering domain teams with an open data platform

Sandhya Menon Sandhya Menon · World Congress 2026 Europe

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

2:07 min

Inspecting default bridge architectures and custom Docker networks

Oliver Seitz Oliver Seitz · World Congress 2025

45 sec

Working securely with Node.js path application programming interfaces

Sonya Moisset · World Congress 2023

2:57 min

Core technical practices for robust data engineering

Sandhya Menon Sandhya Menon · World Congress 2026 Europe

2:34 min

Docker sandbox architecture and microVM environment integration

Manuel de la Peña Manuel de la Peña · World Congress 2026 Europe

Videos

See all

Related articles

See all