AI Data Engineer

SR2
Charing Cross, United Kingdom
20 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Compensation
£ 73K

Job location

Charing Cross, United Kingdom

Tech stack

Artificial Intelligence
Airflow
Amazon Web Services (AWS)
Azure
Google BigQuery
Cloud Computing
Data Architecture
Data Systems
Distributed Systems
Python
Performance Tuning
Prometheus
Data Streaming
Data Storage Technologies
Data Ingestion
Snowflake
Grafana
Data Lake
Kubernetes
Apache Flink
Kafka
Spark Streaming
Machine Learning Operations
Terraform
Data Pipelines
Docker
Redshift

Job description

You'll be working in close collaboration with ML engineers, product leads, and platform teams to make sure the company's AI models are learning, and improving, in production.

What You'll Be Doing

  • Architect and maintain real-time streaming data systems (Kafka, Kinesis, or Flink)
  • Build robust feature pipelines using Airflow, Prefect, or Dagster
  • Manage and optimise data storage solutions (Snowflake, BigQuery, Redshift, or Delta Lake)
  • Automate and scale model training pipelines in close partnership with ML engineers
  • Deploy, observe, and improve pipelines using Docker, Kubernetes, Terraform, or dbt
  • Champion data reliability, scalability, and performance across the platform

The Tech Environment

You'll likely be working with some combination of:

  • Languages: Python, Scala, Go
  • Streaming: Kafka / Flink / Spark Structured Streaming
  • Workflow orchestration: Airflow / Prefect / Dagster
  • Data storage & processing: Snowflake / Detabricks / BigQuery / Redshift
  • Infrastructure: Docker / Kubernetes / Terraform / dbt
  • Monitoring: Prometheus / Grafana / OpenTelemetry
  • Cloud: AWS / GCP / Azure

Requirements

  • Proven experience building scalable data pipelines in real-time or near real-time environments
  • Strong background in data architecture, performance tuning, and distributed systems
  • Comfort working end-to-end - from data ingestion to model-ready outputs
  • An interest in AI, ML ops, and data-driven product development
  • Someone who thrives in fast-moving, high-ownership start-up environments

Benefits & conditions

  • Be the first Data Engineer, shaping the entire data backbone
  • Work with exceptionally talented engineers and researchers solving real-world AI problems
  • Competitive package, plus meaningful equity
  • A culture that values autonomy, creativity, and continuous learning

Interested?

If you've built or scaled data pipelines in production and want to be part of something genuinely cutting-edge, I'd love to chat.

About the company

I'm currently partnered with a next-generation AI startup that's building real-time intelligence systems capable of understanding and adapting to the world as it happens. They're at the forefront of streaming data, continuous learning, and large-scale inference - and they're now looking for a Data Engineer to help power that mission. This isn't a maintenance role. It's a build-it-from-the-ground-up opportunity in a company that's solving genuinely hard, technical problems around real-time data pipelines and ML infrastructure.

Apply for this position