AI Engineer, Agent Infrastructure

Ai, Inc
San Francisco, CA, United States
2 days ago
Apply on startup.jobs
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Job source

Tech stack

Application Programming Interfaces (APIs) Artificial Intelligence Software Debugging Distributed Systems Workflow Management Systems Large Language Models Multi-Agent Systems Backend

Job description

We’re hiring an engineer to own the infrastructure layer behind our production AI agents.

This is not a prompt engineering role. It’s not a UI role. It’s about the harness around LLMs - the systems that determine how agents actually execute tasks, interact with tools, access internal and external systems, stay within permission boundaries, and behave reliably in production.

You’ll sit at the intersection of backend infrastructure and product, and what you build will define how AI is deployed across the company., * Build and own the execution layer for AI agents - task orchestration, tool calling, state management

  • Define how agents interact with internal systems and external APIs
  • Design sandboxed environments and permissioning models for safe, controlled agent execution
  • Build evaluation, monitoring, and debugging infrastructure for agent behavior in production
  • Integrate agents into real product workflows where correctness and reliability are non-negotiable
  • Improve system performance across latency, cost, and quality tradeoffs

Requirements

  • Direct experience shipping production LLM or agent systems end-to-end - orchestration, evaluation, reliability, not just prototypes
  • Strong backend or infrastructure engineering foundation (distributed systems, APIs, platform engineering)
  • Experience with workflow orchestration, automation systems, or agent frameworks
  • Familiarity with evaluation and observability loops for AI systems
  • Ability to think across both infrastructure concerns and product behavior - this role requires both

Strong Signals

  • You’ve built agent systems that take real actions, not just generate text
  • You’ve designed execution environments - task runners, sandboxes, job systems
  • You’ve worked on AI that’s deeply embedded in a real product, not a side project or internal tool
  • You have experience with observability and evaluation loops for AI systems in production

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on startup.jobs
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

1:24 min

Building client-facing AI agents for engineering teams

Alfonso Graziano Alfonso Graziano ¡ Coffee With Developers

1:52 min

Structuring and scaling the backend engineering team

Stefan Lingler Stefan Lingler +1 ¡ Coffee With Developers

2:08 min

The vending machine trap in software debugging

Jen Callou Jen Callou ¡ Europe 2026 Virtual

1:29 min

Overcoming challenges in AI-assisted distributed system development

Przemysław Ładyński Przemysław Ładyński · World Congress 2026 Europe

1:47 min

Expanding AI agents across workflows and team structures

Brian Scanlan Brian Scanlan ¡ World Congress 2026 Europe

1:12 min

Choosing TypeScript for complex backend applications

Maximilian Otto Maximilian Otto ¡ World Congress 2024

Videos

See all

Related articles

See all