Lead Data Engineer
Understanding Recruitment
Greater London, UK
21 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Compensation
£100,000.0
Working hours
Regular working hours
Job source
Tech stack
Artificial Intelligence
Amazon Web Services
Microsoft Azure
Data Architecture
Extract Transform Load (ETL)
Python (Programming Language)
Machine Learning
Standard Sql
Software Deployment
SQL Databases
Google Cloud
Cloud Platform System
+5 more
Apache Spark
Pyspark
Virtual Agents
Data Pipelines
Databricks
Job description
Lead Data Engineer - London (Hybrid)
A fast-growing AI and data consultancy that helps global businesses unlock insights from consumer data using cloud-native platforms, machine learning and agentic AI are looking for a Lead Data Engineer to help shape both the technology and the engineering team.
What you’ll be doing:
- Lead the design and delivery of enterprise-scale data and AI platforms
- Build cloud-native solutions using Databricks, Azure, AWS and GCP
- Develop scalable ETL/ELT pipelines with Python, PySpark and SQL
- Define engineering standards and mentor a team of Data & Platform Engineers
- Work on AI deployment, orchestration and monitoring in production
- Collaborate with clients, architects, data scientists and product teams to deliver high-impact solutions
What we’re looking for:
- Strong experience building cloud-based data platforms
- Expertise with Python, SQL, Spark/PySpark and Databricks
- Experience designing scalable data architectures and modern data pipelines
- Previous technical leadership or mentoring experience
- Azure, AWS or GCP experience
What’s in it for you?
- Salary up to £100,000
- Generous pension contribution, private healthcare, personal learning budget etc.
- Clear progression and exposure to cutting-edge AI and agentic technologies
Apply now for immediate consideration!
Requirements
- Strong experience building cloud-based data platforms
- Expertise with Python, SQL, Spark/PySpark and Databricks
- Experience designing scalable data architectures and modern data pipelines
- Previous technical leadership or mentoring experience
- Azure, AWS or GCP experience
Benefits & conditions
- Salary up to £100,000
- Generous pension contribution, private healthcare, personal learning budget etc.
- Clear progression and exposure to cutting-edge AI and agentic technologies
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.understandingrecruitment.comGood distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
EM
Eli McGarvie
about 3 years ago
EM
Eli McGarvie
Data Analyst Salary in the UK
about 3 years ago
LM
Luis Minvielle
How to Become an AI Engineer
over 2 years ago
EM
Eli McGarvie
Software Engineer Salary London
about 3 years ago
ER
Erin Rifkin
Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud
about 1 year ago
DS
Dhannush Subramani
Top Big Data Technologies That You Need to Know
about 4 years ago