> Markdown version of [/jobs/ext/2286512-lead-data-migration-engineer](https://www.wearedevelopers.com/jobs/ext/2286512-lead-data-migration-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Lead Data Migration Engineer - **Company:** NTT DATA - **Location:** London, UK - **Experience:** Expert - **Salary:** £55,000.0 - £95,000.0 - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Amazon Web Services, Amazon S3, Apache HTTP Server, Application Frameworks, Automation of Tests, Cloud Computing, Continuous Integration, Information Engineering, Data Integrity, Extract Transform Load (ETL), Data Transformation, Data Migration, Data Security, Data Warehousing, Software Design Patterns, Distributed Computing Environment, Information Lifecycle Management, Python (Programming Language), Performance Tuning, Cloud Services, Standard Sql, SQL Databases, Data Streaming, YAML, Cloud Platform System, Apache Spark, Data Lakes, Pyspark, AWS Glue, AWS Data Analytics, Data Lakehouse, Software Version Control, Data Pipelines - **Published:** August 29, 2026 - **Apply:** https://www.adzuna.co.uk/jobs/details/5859602119 ## About the Role * Proven experience in data engineering and data migration delivery, particularly within cloud environments * Strong focus on data pipeline testing, validation, and quality assurance * Ability to work across the full data lifecycle, with emphasis on migration and transformation * Strong analytical, problem-solving, and communication skills * Experience working in client-facing and delivery-focused environments * Ability to mentor junior engineers and contribute to team delivery * Strong hands-on experience with AWS cloud services, especially AWS Glue * Strong hands-on experience with Python / PySpark for data transformation * Strong hands-on experience with SQL for querying, validation, and reconciliation * Strong hands-on experience with YAML configuration for pipeline orchestration * Experience testing and validating end-to-end ETL/ELT pipelines and data migration workflows * Familiarity with Apache Iceberg and Lakehouse architectures * Familiarity with distributed processing frameworks such as Apache Spark * Familiarity with data lake environments * Understanding of ETL vs ELT design patterns and migration performance tuning * Experience with version control and CI/CD tools is desirable ## Description * Work as a senior engineer within data migration programmes, supporting delivery across complex transformation initiatives * Collaborate with architects and stakeholders to implement migration strategies and technical solutions * Contribute to project planning, estimation, and execution of migration deliverables * Design, build, and optimise data migration pipelines from legacy data warehouses to AWS-based Data Lakehouse platforms * Develop and maintain ETL/ELT pipelines using AWS Glue, Python / PySpark, SQL, and YAML-driven configurations * Implement bulk data migration processes followed by incremental/delta loads * Support pipeline repointing and replatforming to target cloud architectures * Test end-to-end ETL data solutions running on AWS services, including AWS Glue and Apache Iceberg * Validate data feed pipeline migrations transitioning to new AWS Data Lakehouse architectures * Test pipelines underpinned by AI ETL accelerators, Python/PySpark transformations, SQL-based logic, and YAML configuration-driven orchestration * Execute and validate initial bulk data loads and subsequent incremental/delta migrations * Develop and run SQL-based validation and reconciliation queries to ensure data completeness, accuracy, and transformation correctness * Support creation of automated testing and validation frameworks * Work hands-on with AWS cloud services, including AWS Glue and S3-based data lakes * Support implementation of Data Lakehouse architectures, including Apache Iceberg * Optimise data pipelines for performance, scalability, and reliability in cloud environments * Apply data transformation logic aligned to migration mapping rules * Support data modelling activities required for target-state schemas * Ensure consistency between source and target systems during migration * Collaborate with solution architects, data engineers, data migration architects, analysts, and QA teams * Promote engineering best practices, reusable components, and automation * Contribute to migration accelerators and reusable frameworks * Ensure data integrity, quality, and traceability throughout migration processes * Follow best practices for secure data handling in regulated environments * Support compliance with GDPR and UK public sector data requirements where applicable * Contribute to audit and validation processes Technologies: * AI * AWS * AWS Glue * CI/CD * Cloud * ETL * Support * Python * PySpark * SQL * Spark * Network, We are a global business that empowers local teams and delivers exciting work that is genuinely changing the world. Our portfolio spans consulting, applications, business process, cloud, and infrastructure services, and you will work with brilliant colleagues and clients on exciting projects. We offer an inclusive work environment built on mutual respect, accountability, and continuous learning, with a strong focus on collaboration, well-being, growth, and agility. We also provide tailored benefits supporting physical, emotional, and financial wellbeing, continuous learning and development opportunities, and flexible work options. We are proud to be an equal opportunities employer and a Disability Confident Committed Employer, with active Inclusion Networks supporting women, cultural and ethnicity, LGBTQ+ and allies, neurodiversity, and parents. ## Related Videos - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering) - [How we built an AI-powered code reviewer in 80 hours](https://www.wearedevelopers.com/videos/1511-how-we-built-an-ai-powered-code-reviewer-in-80-hours) - [CI/CD with Github Actions](https://www.wearedevelopers.com/videos/856-ci-cd-with-github-actions) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london)