> Markdown version of [/jobs/ext/3236571-senior-technical-lead](https://www.wearedevelopers.com/jobs/ext/3236571-senior-technical-lead). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Senior Technical Lead

- **Company:** Luxoft
- **Location:** London, UK
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Artificial Intelligence, Amazon Web Services, Big Data, Continuous Delivery, Continuous Integration, Information Engineering, Data Infrastructure, Extract Transform Load (ETL), Software Design Documents, High-Level Architecture, Power BI, Tensorflow, Reverse Engineering, Data Streaming, Tableau (Software), Data Processing, GitHub Copilot, Cloudformation, Data Lakes, Pyspark, AWS Glue, Data Analytics, Data Management, Machine Learning Operations, Virtual Agents, Terraform, Data Pipelines
- **Published:** September 4, 2026
- **Apply:** https://uk.indeed.com/viewjob?jk=1e049fc9c16f473e

## About the Role

Must have

5+ years experience

hands-on experince with AWS Migration

AWS Glue, Step Functions, Lambda, EventBridge - deep hands-on experience designing solutions using these core AWS services

IaC (Terraform) - strong experience defining and managing infrastructure as code with Terraform

Data platform architecture - proven experience architecting data platforms (data lakes, warehouses, pipelines) at scale

PySpark - hands-on experience with PySpark for large-scale data processing

CI/CD - experience designing and implementing CI/CD pipelines for infrastructure and data workflows

AI/ML frameworks - working knowledge of AI/ML frameworks and their application within architecture design

GitHub Copilot - practical experience using GitHub Copilot within development/architecture workflows

Nice to have

AWS certification (Data Analytics Specialty or Solutions Architect)

Experience with BI tools (QuickSight, Tableau, Power BI)

Infrastructure as Code experience (Terraform/CloudFormation)

Industry experience relevant to your business

Exposure to streaming data (Kinesis) or ML pipelines (SageMaker)

experince in financial domain

## Description

This is a strategic data engineering engagement with our client to architect and plan the migration of their entire data processing and ETL estate from Matillion to AWS Glue - a foundational shift in how one of the world's largest financial market infrastructure companies handles its data pipelines.
During this Mobilisation Phase, you'll work jointly with engineering teams to reverse-engineer the existing landscape, design the target-state architecture across every layer (infrastructure, data processing, workflows, dependencies, and operating model), and build the detailed delivery blueprint that will greenlight the full-scale migration.
The work is technically rich and highly collaborative: you'll review and validate job inventories spanning hundreds of ETL workflows, define reusable migration patterns and templates, design a validation and reconciliation framework, run a proof-of-concept to stress-test the approach, and navigate rigorous internal governance - from Architectural Significance Assessments through Architectural Review Boards to a formal Gate 1 decision.

Responsibilities

 * Target-state architecture design - define and own the target-state AWS architecture across compute, data, and orchestration layers

 * HLD/LLD ownership - produce and own High-Level Design and Low-Level Design documentation for migration workloads

 * ARB submissions - prepare and present architecture proposals to the Architecture Review Board for approval

 * Technical decisions - make and document key technical decisions across the migration program, balancing trade-offs (cost, performance, scalability)

Pattern definition - define reusable architecture and migration patterns for use across teams/pods

 * Agentic AI framework architecture - design the architecture for the Agentic AI migration framework, including its integration with the broader technical landscape


## Related Videos

- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology)
- [Remote Driving on Plant Grounds with State-of-the-Art Cloud Technologies](https://www.wearedevelopers.com/videos/251-remote-driving-on-plant-grounds-with-state-of-the-art-cloud-technologies)
- [How we built an AI-powered code reviewer in 80 hours](https://www.wearedevelopers.com/videos/1511-how-we-built-an-ai-powered-code-reviewer-in-80-hours)
- [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning)
- [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail)

## Related Articles

- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london)
- [Best Companies to work for in London: Top 25 Companies in 2023](https://www.wearedevelopers.com/magazine/187-best-companies-to-work-for-in-london-top-25-companies-in-2023)
- [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift)
- [Why Upskilling And Reskilling is Important For Developers](https://www.wearedevelopers.com/magazine/428-why-upskilling-and-reskilling-is-important-for-developers)