Data Engineer | London, UK
Role details
Job location
Tech stack
Job description
-
Support ledger migration activities, including data extraction, transformation, reconciliation and validation.
-
Work on data lake clean-up, data quality checks, reporting pipelines and downstream feeds.
-
Develop, enhance and validate SQL queries, batch jobs and data processing logic.
-
Perform regression testing on batch processes to ensure data accuracy and completeness before and after migration.
-
Collaborate with engineering, product and business teams to understand migration requirements and resolve data issues.
-
Document data mapping, validation rules, test results and migration exceptions clearly.
-
Support production readiness, defect triage and post-migration validation activities.
Requirements
-
Strong hands-on experience with SQL and data analysis across large datasets.
-
Experience with batch processing, batch regression testing and data reconciliation.
-
Working knowledge of Spark or similar distributed data processing technologies.
-
Experience working with data lakes, reporting platforms, feeds and data migration programmes.
-
Ability to identify data inconsistencies, investigate root causes and support remediation.
-
Strong understanding of data quality, controls, validation and auditability in enterprise environments.
-
Good communication skills with the ability to work across engineering, business and product stakeholders.
Preferred Experience
-
Prior experience in financial services, banking, ledger systems or regulatory data environments.
-
Experience supporting enterprise-scale migration, modernisation or platform transformation programmes.
-
Exposure to reporting, dashboards, data views and operational data feeds.
-
Ability to work in distributed teams across London, Bangalore and Singapore.