Data Engineer

You will work directly with our research team on RL environment and task creation for agent training. This means designing observation spaces, action spaces, reward signals, and success criteria for new environments - and building the infrastructure that makes world-scale RL training possible. This is a high-ownership role; you will be building novel systems, not maintaining legacy ones.

3+ years of data engineering experience - pipelines, ETL, data modeling in production or research settings

Strong Python proficiency (numpy, pandas, Parquet, HDF5 are daily tools)

Familiarity with at least one RL framework (Gymnasium / OpenAI Gym, dm_env, or equivalent) and working knowledge of RL environment structure - observation/action spaces, reward signals, episode logic

Experience with data versioning and experiment tracking (DVC, MLflow, W&B, or similar)

Comfortable with Docker and cloud infrastructure (AWS or GCP)

Solid grasp of ML storage formats: Parquet, HDF5, JSON Lines

We are AI researchers and builders who understand how to curate data and RL environments that truly improve models. We curated OpenThoughts, one of the best open reasoning datasets, and have trained SOTA models such as Bespoke-MiniCheck and Bespoke-MiniChart.