> Markdown version of [/jobs/ext/2216420-data-engineering-technical-lead](https://www.wearedevelopers.com/jobs/ext/2216420-data-engineering-technical-lead). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineering Technical Lead - **Company:** Vanguard - **Location:** London, UK - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Agile Methodology, Artificial Intelligence, Amazon Web Services, Data Analysis, Application Frameworks, Automation of Tests, Big Data, Code Review, Computer Programming, Databases, Continuous Integration, Data as a Services, Information Engineering, Data Governance, Extract Transform Load (ETL), Data Systems, Data Vault Modeling, Dimensional Modeling, Python (Programming Language), Machine Learning, Regression Testing, Software Construction, Software Engineering, SQL Databases, Cloud Platform System, GitHub Copilot, Apache Spark, Software Troubleshooting, Generative AI, Data Strategy, Cloudformation, Event Driven Architecture, Infrastructure Automation Frameworks, Data Analytics, Data Management, Machine Learning Operations, Virtual Agents, Terraform, Stream Processing, Software Version Control, Data Pipelines, Databricks - **Published:** August 25, 2026 - **Apply:** http://www.vanguardjobs.com/job/23748719/data-engineering-technical-lead-london-gb/?utm_medium=%22mcloud%2Djobads%22&utm_campaign=Default%20Campaign&utm_content=Data%20Engineering%20Technical%20Lead&utm_term=181560 ## About the Role * Deep expertise designing and building scalable data pipelines and data products in cloud environments * Strong hands-on experience with Databricks, Spark, SQL, and Python * Experience developing and optimizing batch and real-time data processing solutions * Strong understanding of modern data architecture patterns, including Kimball, Data Vault, dimensional modelling, and data product design principles * Experience implementing Infrastructure as Code using tools such as Terraform or CloudFormation * Experience leading technical delivery teams and mentoring data engineers * Strong stakeholder management skills with the ability to translate business requirements into scalable technical solutions * Experience implementing data governance, data quality, security, and operational controls within enterprise platforms * Strong understanding of software engineering best practices including version control, CI/CD, automated testing, and code review processes * Experience working in Agile product delivery environments and collaborating across cross-functional teams * Demonstrated ability to drive technical decision-making and influence architecture direction * Proficiency using AI-assisted development tools such as Claude Code, Codex, GitHub Copilot, or equivalent tools to improve engineering productivity and quality Nice-to-Have Skills & Experience * Experience delivering Financial Services, Wealth Management, Asset Management, or Investment platform data solutions * Experience working with AWS-native data services and event-driven architectures * Experience building data products that support analytics, reporting, machine learning, or AI use cases * Knowledge of MLOps, AI Engineering, Agentic AI, or Generative AI implementation patterns * Experience leading distributed engineering teams * Experience establishing engineering standards, reusable frameworks, and community-of-practice initiatives * Knowledge of data mesh, domain-driven design, and product-centric operating models ## Description The Data Engineering Technical Lead will play a critical role in shaping and delivering Vanguard Europe's data and analytics capabilities. Working within the Chief Data & Analytics Office (CDAO), this role will lead the technical design, development, and evolution of data products that support business decision-making across Financial Advice Services, Marketing, Operations, Risk, and other key business functions. Operating in a modern cloud-based environment leveraging Databricks, AWS, and Infrastructure as Code, the successful candidate will lead a team of data engineers while partnering closely with Product Managers, Data Analysts, Architects, and business stakeholders. The role combines deep technical expertise with strong leadership capabilities, ensuring scalable, secure, and high-quality data solutions are delivered that drive measurable business outcomes. This is an exciting opportunity to influence Vanguard's data strategy, establish engineering best practices, promote AI-enabled software development, and help build a high-performing engineering culture across a growing global team. In this role you will * Write ETL (Extract / Transform / Load) processes, designs database systems and, develops tools for real-time and offline analytic processing * Troubleshoot software and processes for data consistency and integrity. Integrates complex and large scale data from a variety of sources for business partners to generate insight and make decisions. * Translate business specifications into design specifications and code. Responsible for writing complex programs, ad hoc queries, and reports. Ensures that all code is well structured, includes sufficient documentation, and is easy to maintain and reuse * Partner with internal clients to gain an expert understanding of business functions and informational needs. Works closely with other technical and data analytics experts across the business to implement data solutions * Lead all phases of solution development. Explains technical considerations at related meetings, including those with internal clients and less experienced team members * Assess data quality and tests code thoroughly for accuracy of intended purpose. Provides data analysis guidance and serves as a technical consultant for the client * Educate and develops junior data engineers on the team while applying quality control to their work. Develops data engineering standards and contributes expertise to other data expert teams across Vanguard * Test and implement new software releases through regression testing. Identifies issues and engages with vendors to resolve and elevate software into production * Experience in data analytics, programming, database administration, or data management experience * Proficient in spec-driven development using AI coding tools such as Claude Code or Codex. Having AI engineering experience will be a plus ## Related Videos - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [Infrastructure as Code: The Developer's Secret Weapon](https://www.wearedevelopers.com/videos/1221-infrastructure-as-code-the-developer-s-secret-weapon) - [Kubernetes and Microservices with Multi-Model Databases](https://www.wearedevelopers.com/videos/382-kubernetes-and-microservices-with-multi-model-databases) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [Implementing Feature Environments with AWS and Terraform](https://www.wearedevelopers.com/videos/531-implementing-feature-environments-with-aws-and-terraform) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift) - [Graph and AI Trends 2026: Why Is AI Running but Not Yet Delivering?](https://www.wearedevelopers.com/magazine/680-graph-and-ai-trends-2026-why-is-ai-running-but-not-yet-delivering) - [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again)