Data Platform Engineer - AI & LLM Systems
Role details
Job location
Tech stack
Job description
API Design and Delivery: Design and build stable, well-documented APIs that internal teams, paying customers, and our AI product depend on. Backwards compatibility, versioning, and developer experience matter here.
Data Presentation Layer: Build the query and response layers that make complex energy market data fast and accessible, thinking carefully about latency, caching, and how data needs to be shaped for different consumers.
Full Lifecycle Ownership: Work with the product team to decide what to build and how to measure success, scope and implement the work, deploy it, and keep it running. You own what you ship.
Pipeline and Data Architecture: You won't be building pipelines day-to-day, but you'll contribute to how our pipeline platform evolves and maintain the infrastructure it runs on.
Infrastructure and DevOps: Write and maintain Terraform, manage cloud infrastructure, and monitor platform health and API performance as a normal part of your working week.
Code Quality: Write well-tested, maintainable code and contribute to engineering culture through thoughtful code review and clear documentation of design decisions.
Requirements
4+ years of professional software development experience with a strong track record of delivering production-quality systems.
A track record of designing and shipping external-facing APIs, with real attention to versioning, backwards compatibility, and OpenAPI/REST standards.
Hands-on experience with infrastructure-as-code and cloud infrastructure day-to-day. We build on AWS with Terraform, but equivalent experience is fine.
Genuine excitement about making AI tools a core part of how you work.
Experience with any part of our data stack would be beneficial: Django REST Framework, Apache Airflow, Apache Spark, Apache Iceberg, Apache Kafka, Terraform, and AWS (EMR, ECS). We manage much of this ourselves, so experience running your own Airflow cluster or working with Spark at the infrastructure level rather than just the API level is particularly valuable.
Benefits & conditions
Hybrid workingEveryone works in the office Tuesday through Thursday, with flexibility to work from home or the office on Mondays and Fridays.
BenefitsPrivate Healthcare and Dental cover through Bupa, salary sacrifice pension with 3% employer contribution; 25 days annual leave (excluding bank holidays), plus 5 flexible days to be taken on a Monday or a Friday. And lots of snack and drinks - obviously!