> Markdown version of [/jobs/ext/2301671-data-engineer](https://www.wearedevelopers.com/jobs/ext/2301671-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Data Engineer

- **Company:** Nigel Frank International
- **Location:** Greater London, UK
- **Contract:** Permanent contract
- **Skills:** Data Deduplication, Data Profiling, Parsing, Performance Tuning, Spatial Data Infrastructures, Data Logging, Scripting, Azure Data Factory, Apache Spark, SC Clearance, Pandas, Matplotlib, Scikit Learn, Tools for Reporting, Raster Graphics
- **Published:** August 30, 2026
- **Apply:** https://www.collegerecruiter.com/job/2815449822-data-engineer

## About the Role

* Experience establishing import/export patterns, including handling data extracts, schema discovery, incremental loading and normalising data across multiple source systems.
 * Strong capability in data-transformation-heavy pipelines covering profiling, cleansing, standardisation, conformance and final data publishing.
 * Advanced SQL expertise including profiling, joins/merges, deduplication, anomaly detection and performance tuning.
 * Practical Python scripting experience for automation, parsing, rules engines and data-quality checks, using libraries such as Pandas/Polars, scikit-learn or matplotlib.
 * Experience with modern data tooling (e.g., Spark, Azure Data Factory) or the ability to deliver equivalent functionality in code-based environments.
 * Proven experience working with geospatial datasets (vector, raster, GeoJSON, shapefiles), including coordinate systems, spatial data handling and geospatial analysis workflows.
 * Ability to interpret geographical context and aggregate/upscale local or regional geospatial insights into coherent national- or region-level datasets.
 * Experience working with publicly available official datasets (e.g., census boundaries, geographic lookups, deprivation indices, population estimates).
 * Capability to design rules for completeness, validity and consistency, and to implement exception handling and reconciliation flows.
 * Ability to build version-controlled pipelines with deterministic transformations, logging, lineage and full traceability of data changes.
 * Comfortable working in a secure environment with least-privilege access principles, secure storage/transfer practices and handling of sensitive personal data.

Soft Skills

 * Strong communication and collaboration skills.
 * A team-focused, cooperative approach.
 * Enthusiasm, engagement and a positive attitude.
 * Proactivity-comfortable working independently without constant direction.
 * Ability to handle ambiguity and adapt to change effectively.

Nice-to-Have Skills

 * Experience working with healthcare or medical-sector datasets, including patient/episode-style records or longitudinal histories.
 * Experience building automated data-profiling dashboards or reporting frameworks., Candidates must be eligible for UK Security Clearance due to the sensitive nature of the data involved.

## Description

A skilled Data Engineer is required to support a major data-transformation workstream within a clinical screening and diagnostics environment. The project focuses on modernising an end-to-end screening service through modern, data-driven digital capabilities. You will join a small specialist team responsible for analysing complex datasets spread across multiple system instances, resolving data-quality challenges, and shaping future data models and structures.


## Related Videos

- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [Advanced Typing in TypeScript](https://www.wearedevelopers.com/videos/496-advanced-typing-in-typescript)
- [Tips and Tricks for Working with JSON](https://www.wearedevelopers.com/videos/1229-tips-and-tricks-for-working-with-json)
- [JavaScript? No. Java Scripts! - Scripting with Java](https://www.wearedevelopers.com/videos/2094-javascript-no-java-scripts-scripting-with-java)
- [Data Science on Software Data](https://www.wearedevelopers.com/videos/162-data-science-on-software-data)
- [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail)

## Related Articles

- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk)
- [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london)
- [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market)
- [Software Engineer Salary in The UK](https://www.wearedevelopers.com/magazine/231-software-engineer-salary-in-the-uk)
- [IT Salaries in UK](https://www.wearedevelopers.com/magazine/288-it-salaries-in-uk)