> Markdown version of [/jobs/ext/3147731-senior-data-engineer-ai-tooling](https://www.wearedevelopers.com/jobs/ext/3147731-senior-data-engineer-ai-tooling). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Data Engineer (AI/Tooling) - **Company:** Luxoft - **Location:** London, UK - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Amazon Web Services, Automation of Tests, Code Generation, Information Engineering, Extract Transform Load (ETL), JSON, Python (Programming Language), Systems Integration, Data Processing, GitHub Copilot, Large Language Models, Prompt Engineering, Build Management, AWS Glue, Virtual Agents, Data Pipelines - **Published:** September 4, 2026 - **Apply:** https://uk.indeed.com/viewjob?jk=2db32a49409c470b ## About the Role Must have Python - strong hands-on Python development experience for building tools and automation GenAI/LLM integration - experience integrating GenAI/LLM capabilities into applications, workflows, or tooling Prompt engineering - hands-on experience designing, testing, and optimizing prompts for LLM-based tools AWS Bedrock - hands-on experience with AWS Bedrock for building GenAI-powered applications GitHub Copilot - practical experience using and/or integrating GitHub Copilot into development workflows Automation frameworks - experience designing and building automation frameworks/tooling from scratch Testing - strong experience with test automation and validation frameworks to ensure conversion accuracy Matillion JSON parsing - experience parsing, interpreting, and transforming Matillion job definitions (JSON format) Nice to have Experience in financial domain ## Description This is a strategic data engineering engagement with our client to architect and plan the migration of their entire data processing and ETL estate from Matillion to AWS Glue - a foundational shift in how one of the world's largest financial market infrastructure companies handles its data pipelines. During this Mobilisation Phase, you'll work jointly with client's engineering teams to reverse-engineer the existing landscape, design the target-state architecture across every layer (infrastructure, data processing, workflows, dependencies, and operating model), and build the detailed delivery blueprint that will greenlight the full-scale migration. The work is technically rich and highly collaborative: you'll review and validate job inventories spanning hundreds of ETL workflows, define reusable migration patterns and templates, design a validation and reconciliation framework, run a proof-of-concept to stress-test the approach, and navigate client's rigorous internal governance - from Architectural Significance Assessments through Architectural Review Boards to a formal Gate 1 decision. This is the kind of engagement where your recommendations directly shape a multi-phase, multi-million-pound programme: the target-state framework you produce here becomes the blueprint that a larger delivery team will execute against. Perfect opportunity for combining deep data engineering knowledge with architecture leadership, stakeholder influence, and structured delivery planning inside a Tier 1 financial services environment Responsibilities Agentic AI Migration Framework development - design and build an agentic AI framework to automate and accelerate migration workflowsж Pattern library build - develop and maintain a library of reusable migration patterns/templates for common conversion scenarios; * Automated conversion pipeline - build pipelines that automatically convert/transform code and configurations (e.g., Matillion jobs) as part of the migration process; * GitHub Copilot integration for code generation - integrate GitHub Copilot into the migration workflow to accelerate code generation and conversion tasks; * Support factory pods - provide technical support, tooling, and troubleshooting to migration factory pods executing migrations at scale ## Related Videos - [How we built an AI-powered code reviewer in 80 hours](https://www.wearedevelopers.com/videos/1511-how-we-built-an-ai-powered-code-reviewer-in-80-hours) - [How E.On productionizes its AI model & Implementation of Secure Generative AI.](https://www.wearedevelopers.com/videos/623-how-e-on-productionizes-its-ai-model-implementation-of-secure-generative-ai) - [Why and when should we consider Stream Processing frameworks in our solutions](https://www.wearedevelopers.com/videos/1085-why-and-when-should-we-consider-stream-processing-frameworks-in-our-solutions) - [Tips and Tricks for Working with JSON](https://www.wearedevelopers.com/videos/1229-tips-and-tricks-for-working-with-json) - [Introducing JSON Structure](https://www.wearedevelopers.com/videos/100219-introducing-json-structure) - [How to Avoid LLM Pitfalls - Mete Atamel and Guillaume Laforge](https://www.wearedevelopers.com/videos/1328-how-to-avoid-llm-pitfalls-mete-atamel-and-guillaume-laforge) ## Related Articles - [13 AI Tools You Have to Try](https://www.wearedevelopers.com/magazine/219-13-ai-tools-you-have-to-try) - [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models) - [Dev Digest 121 - AI goes offline](https://www.wearedevelopers.com/magazine/456-dev-digest-121-ai-goes-offline) - [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud) - [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers) - [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development)