Lead Data Engineer

Understanding Recruitment
Charing Cross, United Kingdom
3 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior
Compensation
£ 100K

Job location

Charing Cross, United Kingdom

Tech stack

Artificial Intelligence
Amazon Web Services (AWS)
Azure
Data Architecture
ETL
Python
Machine Learning
Standard Sql
Software Deployment
SQL Databases
Google Cloud Platform
Cloud Platform System
Spark
PySpark
Virtual Agents
Data Pipelines
Databricks

Job description

Lead Data Engineer - London (Hybrid)

A fast-growing AI and data consultancy that helps global businesses unlock insights from consumer data using cloud-native platforms, machine learning and agentic AI are looking for a Lead Data Engineer to help shape both the technology and the engineering team.

What you'll be doing:

  • Lead the design and delivery of enterprise-scale data and AI platforms
  • Build cloud-native solutions using Databricks, Azure, AWS and GCP
  • Develop scalable ETL/ELT pipelines with Python, PySpark and SQL
  • Define engineering standards and mentor a team of Data & Platform Engineers
  • Work on AI deployment, orchestration and monitoring in production
  • Collaborate with clients, architects, data scientists and product teams to deliver high-impact solutions

What we're looking for:

  • Strong experience building cloud-based data platforms
  • Expertise with Python, SQL, Spark/PySpark and Databricks
  • Experience designing scalable data architectures and modern data pipelines
  • Previous technical leadership or mentoring experience
  • Azure, AWS or GCP experience

What's in it for you?

  • Salary up to £100,000
  • Generous pension contribution, private healthcare, personal learning budget etc.
  • Clear progression and exposure to cutting-edge AI and agentic technologies

Apply now for immediate consideration!

Requirements

  • Strong experience building cloud-based data platforms
  • Expertise with Python, SQL, Spark/PySpark and Databricks
  • Experience designing scalable data architectures and modern data pipelines
  • Previous technical leadership or mentoring experience
  • Azure, AWS or GCP experience

Benefits & conditions

  • Salary up to £100,000
  • Generous pension contribution, private healthcare, personal learning budget etc.
  • Clear progression and exposure to cutting-edge AI and agentic technologies

Apply for this position