> Markdown version of [/jobs/ext/4629290-senior-software-engineer-agent-infrastructure](https://www.wearedevelopers.com/jobs/ext/4629290-senior-software-engineer-agent-infrastructure). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Senior Software Engineer, Agent Infrastructure

- **Company:** COHERE, LLC
- **Location:** San Francisco, CA, United States (Remote available)
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Systems Engineering, User Authentication, File Systems, Distributed Systems, Fault Tolerance, Routing, Rapid Prototyping Process, Secure Coding, Large Language Models, Agentic-AI, Kubernetes, Machine Learning Operations
- **Published:** November 7, 2026
- **Apply:** https://www.juju.com/job/28_25303_b9be24277323fad1fea273b0b26e7578

## About the Role

Requirements: Candidates should have experience building production ML infrastructure and strong systems fundamentals, including scalable, fault-tolerant distributed systems and Kubernetes. Relevant experience with agentic systems, model routing, rapid prototyping, and deciding what is ready for production is also sought.

Key Skills: Production ML Infrastructure, Systems Engineering, Agentic AI Systems, Distributed Systems, Kubernetes, Model Routing, LLM Provider Frameworks, Secure Code Execution, Identity and Authentication, Resource Management, State Management, Fault Tolerance, Storage Systems, Filesystem Abstractions, Code Execution Sandboxes, Productionization

## Description

Build production-ready infrastructure for agentic AI, including secure execution, identity and authentication, model routing, resource management, and agent state capabilities. Prototype and evaluate technologies, develop core platform capabilities, and collaborate with research teams to shape infrastructure for future agent systems.