Lead Data Engineer

FBI &TMT
Charing Cross, United Kingdom
11 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Charing Cross, United Kingdom

Tech stack

Artificial Intelligence
Airflow
Amazon Web Services (AWS)
Azure
Cloud Computing
Information Engineering
Data Governance
Relational Databases
Distributed Data Store
Elasticsearch
Python
PostgreSQL
NoSQL
Query Optimization
Search Technologies
Spark
Backend
Data Layers
Event Driven Architecture
Kafka
Data Pipelines

Job description

  • Architect and build scalable data pipelines and distributed data systems
  • Design ingestion, transformation and storage patterns for operational and AI workloads
  • Deliver batch and real-time/streaming pipelines
  • Build and optimise vector search and retrieval pipelines that support AI features
  • Implement monitoring, observability and data quality frameworks
  • Drive security, reliability and governance across the data layer
  • Partner closely with backend and AI engineers to support training, inference and product delivery
  • Influence technical direction and help shape the future data team as the company scales

Requirements

  • Demonstrable experience in data engineering or backend engineering with proven architecture ownership
  • Good level of Python engineering skills
  • Strong relational database experience (PostgreSQL preferred) including performance and query optimisation
  • Exposure to NoSQL systems
  • Comfortable building from scratch in a fast-moving, product-led environment
  • Experience with vector databases and vector search in modern AI systems
  • Desirable: Spark, Airflow, Kafka, Elasticsearch/OpenSearch, event-driven architectures
  • Cloud experience (AWS, GCP or Azure) is a plus

Benefits & conditions

Why join

  • High impact and ownership as an early senior hire
  • Work with a strong engineering team on real AI product challenges
  • Competitive salary

About the company

A high-growth AI software company is looking for a Lead Data Engineer to own and scale the data foundations behind an AI-driven operations platform used by property teams. This is a hands-on, high-ownership role where you'll define the data architecture, set engineering standards and build systems that power product analytics and modern AI capabilities.

Apply for this position