Data Engineer | London, UK

Photon Group
London, UK
28 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Compensation
£48,478.0
Working hours
Regular working hours

Tech stack

Accounting Systems Data Analysis Audit Trail Batch Processing Big Data Software Bug Management Data Validation Data Infrastructure Data Migration Data Mining Distributed Computing Environment Document-Oriented Databases
+8 more
Operational Data Store Regression Testing SQL Databases Data Processing Apache Spark Data Lakes Tools for Reporting Data Inconsistencies

Job description

  • Support ledger migration activities, including data extraction, transformation, reconciliation and validation.

  • Work on data lake clean-up, data quality checks, reporting pipelines and downstream feeds.

  • Develop, enhance and validate SQL queries, batch jobs and data processing logic.

  • Perform regression testing on batch processes to ensure data accuracy and completeness before and after migration.

  • Collaborate with engineering, product and business teams to understand migration requirements and resolve data issues.

  • Document data mapping, validation rules, test results and migration exceptions clearly.

  • Support production readiness, defect triage and post-migration validation activities.

Requirements

  • Strong hands-on experience with SQL and data analysis across large datasets.

  • Experience with batch processing, batch regression testing and data reconciliation.

  • Working knowledge of Spark or similar distributed data processing technologies.

  • Experience working with data lakes, reporting platforms, feeds and data migration programmes.

  • Ability to identify data inconsistencies, investigate root causes and support remediation.

  • Strong understanding of data quality, controls, validation and auditability in enterprise environments.

  • Good communication skills with the ability to work across engineering, business and product stakeholders.

Preferred Experience

  • Prior experience in financial services, banking, ledger systems or regulatory data environments.

  • Experience supporting enterprise-scale migration, modernisation or platform transformation programmes.

  • Exposure to reporting, dashboards, data views and operational data feeds.

  • Ability to work in distributed teams across London, Bangalore and Singapore.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.adzuna.co.uk

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

3:28 min

Defining big data and machine learning fundamentals

Ayon Roy · LIVE

3:24 min

The governance failures of centralized data lakes

Mario Meir-Huber · LIVE

3:56 min

Leveraging GitOps for AI auditing and instant rollbacks

Jaroslaw Gajewski Jaroslaw Gajewski · WWC Europe 2026

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

2:10 min

Why organizations combine big data and machine learning

Ayon Roy · LIVE

Videos

See all

Related articles

See all