Data Engineering Technical Lead

Hackajob Ltd
Leeds, UK
1 day ago
Apply on www.adzuna.co.uk
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Compensation
£61,000.0 - £101,000.0
Working hours
Regular working hours

Tech stack

Agile Methodology Artificial Intelligence Amazon Web Services Data Analysis Application Frameworks Automation of Tests Big Data Cloud Computing Code Review Computer Programming Databases Continuous Integration
+33 more
Data as a Services Information Engineering Data Governance Extract Transform Load (ETL) Data Systems Data Vault Modeling Dimensional Modeling Github Python (Programming Language) Machine Learning Regression Testing Standard Sql Software Construction SQL Databases Working Model 2D Cloud Platform System GitHub Copilot Apache Spark Software Troubleshooting Generative AI Cloudformation Event Driven Architecture Infrastructure Automation Frameworks Data Analytics Data Management Machine Learning Operations Virtual Agents Terraform Stream Processing Domain Driven Design Software Version Control Data Pipelines Databricks

Job description

  • Lead the technical design, development, and evolution of data products that support business decision-making across Financial Advice Services, Marketing, Operations, Risk, and other key business functions
  • Lead a team of data engineers while partnering closely with Product Managers, Data Analysts, Architects, and business stakeholders
  • Write ETL processes, design database systems, and develop tools for real-time and offline analytic processing
  • Troubleshoot software and processes for data consistency and integrity
  • Integrate complex, large-scale data from a variety of sources for business partners to generate insight and make decisions
  • Translate business specifications into design specifications and code
  • Write complex programs, ad hoc queries, and reports
  • Ensure that all code is well structured, includes sufficient documentation, and is easy to maintain and reuse
  • Partner with internal clients to gain an expert understanding of business functions and informational needs
  • Work closely with other technical and data analytics experts across the business to implement data solutions
  • Lead all phases of solution development
  • Explain technical considerations in meetings, including those with internal clients and less experienced team members
  • Assess data quality and test code thoroughly for accuracy of intended purpose
  • Provide data analysis guidance and serve as a technical consultant for the client
  • Educate and develop junior data engineers while applying quality control to their work
  • Develop data engineering standards and contribute expertise to other data expert teams across Vanguard
  • Test and implement new software releases through regression testing
  • Identify issues and engage with vendors to resolve and elevate software into production

Technologies:

  • Agentic AI
  • AI
  • AWS
  • CI/CD
  • Claude Code
  • Cloud
  • Copilot
  • Data Vault
  • Databricks
  • ETL
  • GitHub
  • Support
  • LESS
  • Machine Learning
  • Marketing
  • MLOps
  • Python
  • SQL
  • Security
  • Spark
  • Terraform

More:

hackajob is partnering directly with Vanguard to hire for this Data Engineering Technical Lead role within the Chief Data & Analytics Office. We are shaping and delivering Vanguard Europes data and analytics capabilities in a modern cloud-based environment leveraging Databricks, AWS, and Infrastructure as Code. This is a hybrid position requiring office attendance 3 days per week (Tuesday, Wednesday, and Thursday). We are not offering visa sponsorship for this position. We are a different kind of investment company, founded in 1975 on a simple idea: that an investment company should manage its funds solely in the interests of its clients. Our philosophy is to provide value to investors through low-cost, uncomplicated investments. We are committed to diversity and inclusion, and we believe building diverse, inclusive, and highly effective teams helps us better serve our clients, crew, and communities. Our hybrid working model supports flexibility, in-person learning, collaboration, and connection while helping us deliver on our mission to take a stand for all investors, treat them fairly, and give them the best chance for investment success.

Requirements

  • Deep expertise designing and building scalable data pipelines and data products in cloud environments
  • Strong hands-on experience with Databricks, Spark, SQL, and Python
  • Experience developing and optimizing batch and real-time data processing solutions
  • Strong understanding of modern data architecture patterns, including Kimball, Data Vault, dimensional modelling, and data product design principles
  • Experience implementing Infrastructure as Code using tools such as Terraform or CloudFormation
  • Experience leading technical delivery teams and mentoring data engineers
  • Strong stakeholder management skills with the ability to translate business requirements into scalable technical solutions
  • Experience implementing data governance, data quality, security, and operational controls within enterprise platforms
  • Strong understanding of software engineering best practices including version control, CI/CD, automated testing, and code review processes
  • Experience working in Agile product delivery environments and collaborating across cross-functional teams
  • Demonstrated ability to drive technical decision-making and influence architecture direction
  • Proficiency using AI-assisted development tools such as Claude Code, Codex, GitHub Copilot, or equivalent tools to improve engineering productivity and quality
  • Experience in data analytics, programming, database administration, or data management
  • Experience delivering Financial Services, Wealth Management, Asset Management, or Investment platform data solutions
  • Experience working with AWS-native data services and event-driven architectures
  • Experience building data products that support analytics, reporting, machine learning, or AI use cases
  • Knowledge of MLOps, AI Engineering, Agentic AI, or Generative AI implementation patterns
  • Experience leading distributed engineering teams
  • Experience establishing engineering standards, reusable frameworks, and community-of-practice initiatives
  • Knowledge of data mesh, domain-driven design, and product-centric operating models

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.adzuna.co.uk
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

6:36 min

Funding open source through GitHub Accelerator and Sponsors

Stormy Peters · World Congress 2023

3:28 min

Defining big data and machine learning fundamentals

Ayon Roy · LIVE

1:34 min

Essential commands for running and testing Terraform configurations

Hennie Francis · LIVE

1:34 min

Bringing diverse skills to industrial data science roles

Katja Träumner

2:40 min

Using GitHub primitives for internal documentation and corporate operations

Kyle Daigle · Coffee With Developers

Videos

See all

Related articles

See all