> Markdown version of [/jobs/ext/3082582-data-engineering-technical-lead](https://www.wearedevelopers.com/jobs/ext/3082582-data-engineering-technical-lead). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineering Technical Lead - **Company:** Hackajob Ltd - **Location:** Leeds, UK - **Experience:** Expert - **Salary:** £61,000.0 - £101,000.0 - **Contract:** Permanent contract - **Skills:** Agile Methodology, Artificial Intelligence, Amazon Web Services, Data Analysis, Application Frameworks, Automation of Tests, Big Data, Cloud Computing, Code Review, Computer Programming, Databases, Continuous Integration, Data as a Services, Information Engineering, Data Governance, Extract Transform Load (ETL), Data Systems, Data Vault Modeling, Dimensional Modeling, Github, Python (Programming Language), Machine Learning, Regression Testing, Standard Sql, Software Construction, SQL Databases, Working Model 2D, Cloud Platform System, GitHub Copilot, Apache Spark, Software Troubleshooting, Generative AI, Cloudformation, Event Driven Architecture, Infrastructure Automation Frameworks, Data Analytics, Data Management, Machine Learning Operations, Virtual Agents, Terraform, Stream Processing, Domain Driven Design, Software Version Control, Data Pipelines, Databricks - **Published:** September 26, 2026 - **Apply:** https://www.adzuna.co.uk/jobs/details/5898221605 ## About the Role * Deep expertise designing and building scalable data pipelines and data products in cloud environments * Strong hands-on experience with Databricks, Spark, SQL, and Python * Experience developing and optimizing batch and real-time data processing solutions * Strong understanding of modern data architecture patterns, including Kimball, Data Vault, dimensional modelling, and data product design principles * Experience implementing Infrastructure as Code using tools such as Terraform or CloudFormation * Experience leading technical delivery teams and mentoring data engineers * Strong stakeholder management skills with the ability to translate business requirements into scalable technical solutions * Experience implementing data governance, data quality, security, and operational controls within enterprise platforms * Strong understanding of software engineering best practices including version control, CI/CD, automated testing, and code review processes * Experience working in Agile product delivery environments and collaborating across cross-functional teams * Demonstrated ability to drive technical decision-making and influence architecture direction * Proficiency using AI-assisted development tools such as Claude Code, Codex, GitHub Copilot, or equivalent tools to improve engineering productivity and quality * Experience in data analytics, programming, database administration, or data management * Experience delivering Financial Services, Wealth Management, Asset Management, or Investment platform data solutions * Experience working with AWS-native data services and event-driven architectures * Experience building data products that support analytics, reporting, machine learning, or AI use cases * Knowledge of MLOps, AI Engineering, Agentic AI, or Generative AI implementation patterns * Experience leading distributed engineering teams * Experience establishing engineering standards, reusable frameworks, and community-of-practice initiatives * Knowledge of data mesh, domain-driven design, and product-centric operating models ## Description * Lead the technical design, development, and evolution of data products that support business decision-making across Financial Advice Services, Marketing, Operations, Risk, and other key business functions * Lead a team of data engineers while partnering closely with Product Managers, Data Analysts, Architects, and business stakeholders * Write ETL processes, design database systems, and develop tools for real-time and offline analytic processing * Troubleshoot software and processes for data consistency and integrity * Integrate complex, large-scale data from a variety of sources for business partners to generate insight and make decisions * Translate business specifications into design specifications and code * Write complex programs, ad hoc queries, and reports * Ensure that all code is well structured, includes sufficient documentation, and is easy to maintain and reuse * Partner with internal clients to gain an expert understanding of business functions and informational needs * Work closely with other technical and data analytics experts across the business to implement data solutions * Lead all phases of solution development * Explain technical considerations in meetings, including those with internal clients and less experienced team members * Assess data quality and test code thoroughly for accuracy of intended purpose * Provide data analysis guidance and serve as a technical consultant for the client * Educate and develop junior data engineers while applying quality control to their work * Develop data engineering standards and contribute expertise to other data expert teams across Vanguard * Test and implement new software releases through regression testing * Identify issues and engage with vendors to resolve and elevate software into production Technologies: * Agentic AI * AI * AWS * CI/CD * Claude Code * Cloud * Copilot * Data Vault * Databricks * ETL * GitHub * Support * LESS * Machine Learning * Marketing * MLOps * Python * SQL * Security * Spark * Terraform More: hackajob is partnering directly with Vanguard to hire for this Data Engineering Technical Lead role within the Chief Data & Analytics Office. We are shaping and delivering Vanguard Europes data and analytics capabilities in a modern cloud-based environment leveraging Databricks, AWS, and Infrastructure as Code. This is a hybrid position requiring office attendance 3 days per week (Tuesday, Wednesday, and Thursday). We are not offering visa sponsorship for this position. We are a different kind of investment company, founded in 1975 on a simple idea: that an investment company should manage its funds solely in the interests of its clients. Our philosophy is to provide value to investors through low-cost, uncomplicated investments. We are committed to diversity and inclusion, and we believe building diverse, inclusive, and highly effective teams helps us better serve our clients, crew, and communities. Our hybrid working model supports flexibility, in-person learning, collaboration, and connection while helping us deliver on our mission to take a stand for all investors, treat them fairly, and give them the best chance for investment success. ## Related Videos - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [Innovating Developer Tools with AI: Insights from GitHub Next](https://www.wearedevelopers.com/videos/1268-innovating-developer-tools-with-ai-insights-from-github-next) - [Infrastructure as Code: The Developer's Secret Weapon](https://www.wearedevelopers.com/videos/1221-infrastructure-as-code-the-developer-s-secret-weapon) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [Bringing AI Model Testing and Prompt Management to Your Codebase with GitHub Models](https://www.wearedevelopers.com/videos/1536-bringing-ai-model-testing-and-prompt-management-to-your-codebase-with-github-models) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers) - [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Dev Digest 121 - AI goes offline](https://www.wearedevelopers.com/magazine/456-dev-digest-121-ai-goes-offline)