Lead Data Engineer

VIQU Ltd
London, UK
5 days ago
Apply on www.totaljobs.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
2 years minimum
Working hours
Regular working hours

Tech stack

Artificial Intelligence Amazon Web Services Audit Trail Microsoft Azure Cloud Database Code Generation Continuous Integration Information Engineering Extract Transform Load (ETL) Data Profiling Data Structures DevOps
+15 more
Dimensional Modeling Github Python (Programming Language) PostgreSQL Machine Learning Metadata SQL Databases Transact-SQL Data Logging Model Validation Git Data Layers Build Management Git Flow Data Pipelines

Job description

Function Leadership & Team Management

  • Own the Data Engineering function: standards, tooling, and delivery processes
  • Manage, mentor, and develop a team of data engineers including performance and development plans
  • Lead recruitment and be the engineering voice in cross-functional planning

Data Engineering & Architecture

  • Design and build high-performance ETL/ELT pipelines across operational, analytical, and AI data layers
  • Lead schema design, model validation, scalable partitioning, and metadata-driven SQL frameworks
  • Hands-on ownership of the most complex implementation work

Data Modelling & Design

  • Define and evolve data models powering SCV, segmentation, AI features, and analytics
  • Work across dimensional, event-based, and ML-aligned data structures

DevOps, CI/CD & AI Ops

  • Own CI/CD for data pipelines using Git-based workflows, deployment governance, and rollback handling
  • Orchestrate ML model outputs into production pipelines with resilience controls
  • Drive AI tooling adoption across engineering: code generation, data profiling, documentation, and testing
  • Implement structured logging, alerting, SLA tracking, and access control

Key Technologies

  • Cloud: Azure, AWS, or GCP SQL (T-SQL, PostgreSQL), Python, versioned metadata frameworks
  • DevOps: Git, CI/CD (Azure DevOps, GitHub Actions) Monitoring: Custom logging, alerts, structured failure handling
  • Security: Role-based schema access, PII isolation, audit trails

Requirements

  • First-class STEM degree from a prestigious university
  • 5+ years in Data Engineering/Platform roles, 2+ years in a lead or senior capacity
  • Proven line management experience - not just technical leadership
  • Track record of building or improving engineering processes and team structures
  • Expertise in SQL pipelines, Python orchestration, dimensional modelling, and star/snowflake schemas
  • Experience with cloud data infrastructure, CI/CD automation, and metadata frameworks
  • Comfortable working across product, AI, and client delivery teams

Benefits & conditions

  • Build and lead a Data Engineering function from the ground up
  • Work on real-world AI challenges for enterprise clients across multiple sectors
  • Direct mentorship from the CTO and Technical Architect
  • Competitive salary, learning budget, and fast-track growth

About the company

Our client is a leading AI-powered SaaS company that helps businesses unlock the full potential of their first-party data. Their platform transforms complex data into actionable intelligence, enabling clients to drive revenue growth and optimise decision-making. They specialise in Finance, Retail, Travel, Telco, and Healthcare, working with major household-name brands. Currently serving clients in four countries with two live products and two AI solutions in development, this is an exciting time to join as they scale rapidly.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.totaljobs.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

6:21 min

Investigating push inefficiencies with upstream Git experts

Jonathan Creamer · Coffee With Developers

6:36 min

Funding open source through GitHub Accelerator and Sponsors

Stormy Peters · World Congress 2023

1:22 min

Analyzing differences between mobile and traditional backend DevOps

Mete Baydar Mete Baydar · World Congress 2025

1:50 min

Introduction to the speaker and data science background

Bas Geerdink · LIVE

56 sec

Favorite git commands and the importance of patch commits

Eileen Uchitelle Eileen Uchitelle +1 · Coffee With Developers

Videos

See all

Related articles

See all