> Markdown version of [/jobs/ext/1532951-data-engineer-london-uk](https://www.wearedevelopers.com/jobs/ext/1532951-data-engineer-london-uk). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Data Engineer | London, UK

- **Company:** Photon Group
- **Location:** London, UK
- **Salary:** £48,478.0
- **Contract:** Permanent contract
- **Skills:** Accounting Systems, Data Analysis, Audit Trail, Batch Processing, Big Data, Software Bug Management, Data Validation, Data Infrastructure, Data Migration, Data Mining, Distributed Computing Environment, Document-Oriented Databases, Operational Data Store, Regression Testing, SQL Databases, Data Processing, Apache Spark, Data Lakes, Tools for Reporting, Data Inconsistencies
- **Published:** July 15, 2026
- **Apply:** https://www.adzuna.co.uk/jobs/details/5801188580

## About the Role

* Strong hands-on experience with SQL and data analysis across large datasets.

 * Experience with batch processing, batch regression testing and data reconciliation.

 * Working knowledge of Spark or similar distributed data processing technologies.

 * Experience working with data lakes, reporting platforms, feeds and data migration programmes.

 * Ability to identify data inconsistencies, investigate root causes and support remediation.

 * Strong understanding of data quality, controls, validation and auditability in enterprise environments.

 * Good communication skills with the ability to work across engineering, business and product stakeholders.

Preferred Experience

 * Prior experience in financial services, banking, ledger systems or regulatory data environments.

 * Experience supporting enterprise-scale migration, modernisation or platform transformation programmes.

 * Exposure to reporting, dashboards, data views and operational data feeds.

 * Ability to work in distributed teams across London, Bangalore and Singapore.

## Description

* Support ledger migration activities, including data extraction, transformation, reconciliation and validation.

 * Work on data lake clean-up, data quality checks, reporting pipelines and downstream feeds.

 * Develop, enhance and validate SQL queries, batch jobs and data processing logic.

 * Perform regression testing on batch processes to ensure data accuracy and completeness before and after migration.

 * Collaborate with engineering, product and business teams to understand migration requirements and resolve data issues.

 * Document data mapping, validation rules, test results and migration exceptions clearly.

 * Support production readiness, defect triage and post-migration validation activities.


## Related Videos

- [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology)
- [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning)
- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [Resilient by Design: Building Robust Architectures in High-Stakes Financial Systems](https://www.wearedevelopers.com/videos/2106-resilient-by-design-building-robust-architectures-in-high-stakes-financial-systems)
- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [The Data Mesh as the end of the Datalake as we know it](https://www.wearedevelopers.com/videos/156-the-data-mesh-as-the-end-of-the-datalake-as-we-know-it)

## Related Articles

- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk)
- [Best Companies to work for in London: Top 25 Companies in 2023](https://www.wearedevelopers.com/magazine/187-best-companies-to-work-for-in-london-top-25-companies-in-2023)
- [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london)
- [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market)
- [Top-Paying Tech Jobs (with Salaries)](https://www.wearedevelopers.com/magazine/372-top-paying-tech-jobs-with-salaries)