Senior Technical Lead

The Project
London, UK
13 days ago
Apply on www.apply4u.co.uk
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Working hours
Regular working hours

Tech stack

Artificial Intelligence Amazon Web Services Computing Platforms Big Data Software Design Documents High-Level Architecture Power BI Tensorflow Data Streaming Tableau (Software) GitHub Copilot Cloudformation
+7 more
Data Lakes Pyspark Data Analytics Data Management Machine Learning Operations Virtual Agents Terraform

Job description

Architectural Significance Assessments through Architectural Review Boards to a formal Gate 1 decision.ResponsibilitiesTarget-state architecture design - define and own the target-state AWS architecture across compute, data, and orchestration layersHLD/LLD ownership - produce and own High-Level Design and Low-Level Design documentation for migration workloadsARB submissions - prepare and present architecture proposals to the Architecture Review Board for approvalTechnical decisions - make and document key technical decisions across the migration program, balancing trade-offs (cost, performance, scalability)Pattern definition - define reusable architecture and migration patterns for use across teams/podsAgentic AI framework architecture - design the architecture for the Agentic AI migration framework, including its integration with the broader technical landscapeSKILLSMust have5+ years experiencehands-on experince with AWS MigrationAWS Glue, Step Functions, Lambda, EventBridge -

Requirements

deep hands-on experience designing solutions using these core AWS servicesIaC (Terraform) - strong experience defining and managing infrastructure as code with TerraformData platform architecture - proven experience architecting data platforms (data lakes, warehouses, pipelines) at scalePySpark - hands-on experience with PySpark for large-scale data processingCI/CD - experience designing and implementing CI/CD pipelines for infrastructure and data workflowsAI/ML frameworks - working knowledge of AI/ML frameworks and their application within architecture designGitHub Copilot - practical experience using GitHub Copilot within development/architecture workflowsNice to haveAWS certification (Data Analytics Specialty or Solutions Architect)Experience with BI tools (QuickSight, Tableau, Power BI)Infrastructure as Code experience (Terraform/CloudFormation)Industry experience relevant to your businessExposure to streaming data (Kinesis) or ML pipelines (SageMaker)experince in financial domain #J-18808-Ljbffr

About the company

Project descriptionThis is a strategic data engineering engagement with our client to architect and plan the migration of their entire data processing and ETL estate from Matillion to AWS Glue - a foundational shift in how one of the world’s largest financial market infrastructure companies handles its data pipelines.During this Mobilisation Phase, you’ll work jointly with engineering teams to reverse-engineer the existing landscape, design the target-state architecture across every layer (infrastructure, data processing, workflows, dependencies, and operating model), and build the detailed delivery blueprint that will greenlight the full-scale migration.The work is technically rich and highly collaborative: you’ll review and validate job inventories spanning hundreds of ETL workflows, define reusable migration patterns and templates, design a validation and reconciliation framework, run a proof-of-concept to stress-test the approach, and navigate rigorous internal governance - from

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.apply4u.co.uk
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:28 min

Defining big data and machine learning fundamentals

Ayon Roy · LIVE

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

1:24 min

Moving the semantic layer upstream to avoid vendor lock-in

Piotr Menclewicz Piotr Menclewicz · Europe 2026 Virtual

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

2:10 min

Why organizations combine big data and machine learning

Ayon Roy · LIVE

3:37 min

Scaling machine learning pipelines from prototypes to petabytes

Julian Joseph · LIVE

Videos

See all

Related articles

See all