Data Infrastructure

Genesis

London, UK

about 1 month ago

Apply on www.adzuna.co.uk

Prepare application

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Experience level

Expert

Experience required

8 years minimum

Compensation

£65,192.0

Working hours

Regular working hours

Job source

www.adzuna.co.uk

Tech stack

Artificial Intelligence Amazon S3 Data Infrastructure Distributed Systems Python (Programming Language) Software Engineering Data Storage Technologies Data Ingestion Apache Spark Data Lakes Core Data Kubernetes

+3 more

Apache Kafka Terraform Data Pipelines

Job description

Design, build, and maintain large-scale data pipelines (batch and streaming) for robotics foundation model training and evaluation at petabyte scale
Own core data infrastructure: data model, storage systems, ingestion pipelines, transformation frameworks, and orchestration layers
Standardize data models and unify processing pipelines across real-world teleoperation and synthetic simulation datasets
Collaborate with a team of driven individuals committed to building general-purpose Physical AI

Requirements

Excellent software engineering skills (Python, Go, or similar)
Extensive experience designing, building, and maintaining large-scale data pipelines (8+ years)
Deep understanding of distributed systems (Spark, Kafka, or similar)
Extensive experience with data storage technologies (data lakes, warehouses, object stores like S3)
Experience running and maintaining production-grade infrastructure (Kubernetes, Terraform)
Bonus: Experience supporting AI systems, in particular embodied AI like self-driving

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.adzuna.co.uk

Prepare application

Good distractions

Loading talks and stories from around this role…