Research Engineer, Synthetic Data (Pacific Time)
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
Job description
Our client is a fast-growing AI company building reliable, fair and open infrastructure for AI training data. Their marketplace helps the people who create data get value for it, and gives AI labs trustworthy data to train on. It is already used by startups, Fortune 500 companies and frontier labs, and the company is backed by leading venture investors, including Y Combinator. They are scaling quickly to meet strong demand., This is a full-time role, starting ASAP. Offices are in San Francisco and Singapore; remote candidates are welcome if their working hours can overlap about 70-80% with either San Francisco (US Pacific) or Singapore business hours. The exact daily schedule will be agreed during hiring.
What You’ll Do
- Work with subject-matter experts to create synthetic tasks for training AI agents across a range of professional and technical domains.
- Design synthetic task-generation methods that produce diverse, realistic and learnable tasks.
- Build systems and tooling to mutate, validate and improve synthetic tasks.
- Analyse model and agent performance on synthetic tasks to understand what the tasks are teaching and where they fail.
- Develop metrics to quantify and understand synthetic task diversity, realism, learnability and related qualities.
- Take synthetic data pipelines from early research through to reliable systems, including in areas where the roadmap is not fully prescribed., * Build the synthetic data pipeline: You will design the tasks and systems that generate training data at scale, not only run experiments on someone else’s pipeline.
- Research that has to work in production: Turn messy, domain-specific workflows into tasks that are realistic, measurable and usable for training agents.
- See what the data actually teaches: Analyse model and agent performance, and improve the tasks when they fail.
- High ownership, unstructured problems: You will build without a fully prescribed roadmap, from method design through tooling and metrics.
- San Francisco, Singapore, or remote: Work on-site in San Francisco or Singapore, or remotely, with hours that overlap about 70-80% with either US Pacific or Singapore business hours. The exact daily schedule will be agreed during hiring.
Requirements
English Language, Startup, Training/Teaching, Fortune 500 Customers, Artificial Intelligence (AI), Data Management, Sales Pipeline, Analysis Skills, Artificial Intelligence (AI) Agents, Machine Tool, * Proficiency in Python, Docker and Linux environments.
- Experience with synthetic data research methods - please be ready to describe this in your application.
- A strong understanding of what “good synthetic data” means, and of its limitations.
- Experience building synthetic data pipelines end to end, including where there was no fully prescribed roadmap.
- Experience working on environments, evals or benchmarks.
- Clear written and spoken English, and comfort collaborating remotely across time zones.
- Strong candidates may also be detail-oriented enough to catch subtle inconsistencies or edge cases in synthetic data; able to reason from first principles about task design, scoring and failure modes; and comfortable in unstructured problem spaces or early-stage environments.
- Technical aptitude and learning potential matter more than years of experience. Motivated candidates are encouraged to apply even if they don’t meet every point above.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this role…