Senior Data Quality Engineer
gb
Develop
London, UK
18 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.totaljobs.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Compensation
£85,000.0
Working hours
Regular working hours
Job source
Tech stack
Geographic Information Systems
Airflow
Big Data
BigQuery
Web Scraping
Data Integrity
Python (Programming Language)
Node.Js
PostGIS
Standard Sql
SQL Databases
TypeScript
+4 more
Kubernetes
Geospatial Data Abstraction Library (GDAL)
Playwright
Docker
Job description
You will:
- Design and develop data quality checks covering validation, anomaly detection, freshness and coverage.
- Own and improve production web-scraping infrastructure, including Playwright, proxies and anti-bot handling.
- Build and maintain data orchestration workflows using Dagster or similar.
- Develop internal QA and investigation tools to improve how data issues are identified and resolved.
- Use Python, SQL, dbt and BigQuery to diagnose root causes and improve data reliability.
- Work with TypeScript/Node.js where required.
- Partner with data and engineering teams to continuously raise the quality bar.
- Use AI-assisted development tools to build and ship solutions efficiently.
Requirements
- Strong Python and SQL skills, with hands-on dbt and BigQuery experience.
- Proven experience designing data quality, validation and anomaly detection processes.
- Production experience with web scraping at scale, ideally using Playwright or an equivalent.
- Experience with big data sets and big data warehouses
- Experience with proxies, anti-bot measures and scraper monitoring.
- Experience with Dagster, Airflow, Prefect or another data orchestrator.
- Comfort working with TypeScript/Node.js.
- A pragmatic, hands-on approach and strong problem-solving skills.
Desirable:
- Geospatial data experience (PostGIS, GeoPandas, GDAL), GCP/Kubernetes/Docker experience
- Knowledge of the UK property/planning sector.
Benefits & conditions
- 37 days’ annual leave, including birthday and Christmas shutdown
- Hybrid working and home-working equipment
- £500 annual learning and development budget
- Private healthcare
- Salary-sacrifice pension scheme
- Regular team events and monthly team lunches
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.totaljobs.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
EM
Eli McGarvie
over 3 years ago
EM
Eli McGarvie
Data Analyst Salary in the UK
about 3 years ago
EM
Eli McGarvie
Software Engineer Salary London
over 3 years ago
EM
Eli McGarvie
Fullstack Developer Salary UK
over 3 years ago
EM
Eli McGarvie
Software Engineer Salary in The UK
over 3 years ago
EM
Eli McGarvie
Frontend Developer Salary in The UK
over 3 years ago