Founding Harness Engineer - AI Agents
ONE STOP COLLECTIBLE CORP
United States
25 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on startup.jobs
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Working hours
Regular working hours
Job source
Tech stack
Application Programming Interfaces (APIs)
Python (Programming Language)
TypeScript
Large Language Models
Backend
Langfuse — LLM Observability and Analytics Platform
LangSmith
Job description
We move fast. We take ownership. We work with AI, not against it. And we expect everyone to bring ideas, not wait for instructions.
There are no daily checklists, no micromanagement, and no corporate politics. You get autonomy, trust, and a small team that’s always ready to help you grow. Here, impact matters more than titles, and curiosity matters more than seniority.
If you want to level up fast and see your work in real users’ hands - welcome aboard.
Responsibilities
- Build the agent runtime: context, tool choice, approval waits, and knowing when to act, ask, or stay quiet
- Write and keep tuning the system prompts. Proactive is great. Spamming the team channel is not
- Own the eval and regression harness. Prompt changes are code, so they get tested like code
- Make long-running work survive interruptions, retries, and the occasional flaky API
- Put the guardrails in: approval gates for risky actions and strict separation between customers’ data
- Work directly with the founder and early users, and turn what you hear into shipped behavior, * MCP, or integrations with tools like Slack, Gmail, Notion, or Linear
- Eval and tracing tools such as Braintrust, Langfuse, or LangSmith
- You’ve been an early engineer at a startup before and still liked it
Requirements
-
You’ve shipped tool-using LLM agents to real users in production. Demos and prompt wrappers don’t count
- Good instincts for agent initiative, and the test results to back them up
- Hands-on experience building eval and regression suites for LLM behavior
- You understand safe tool execution, prompt injection, and multi-tenant data risk
- Solid backend skills in Python or TypeScript (async jobs, retries, state)
- You take a fuzzy problem from prototype to production and can explain the tradeoffs along the way
- Excellent written and verbal communication; you can explain a tradeoff to a founder or a user without a whiteboard
Benefits & conditions
- A founding seat. You own the agent harness and shape how the product behaves
- Competitive compensation + equity
- A direct line to the founder and early users, with no layers in between
- Remote anywhere in the US, ideally keeping hours that overlap with Pacific time
- The tools and models you need to do the job properly
- A small, experienced team that trusts you to run your own work
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on startup.jobs
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this role…