Senior Software Engineer, Agent Infrastructure

COHERE, LLC
San Francisco, CA, United States
2 days ago
Apply on www.juju.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Working hours
Regular working hours
Job source

Tech stack

Systems Engineering User Authentication File Systems Distributed Systems Fault Tolerance Routing Rapid Prototyping Process Secure Coding Large Language Models Agentic-AI Kubernetes Machine Learning Operations

Job description

Build production-ready infrastructure for agentic AI, including secure execution, identity and authentication, model routing, resource management, and agent state capabilities. Prototype and evaluate technologies, develop core platform capabilities, and collaborate with research teams to shape infrastructure for future agent systems.

Requirements

Requirements: Candidates should have experience building production ML infrastructure and strong systems fundamentals, including scalable, fault-tolerant distributed systems and Kubernetes. Relevant experience with agentic systems, model routing, rapid prototyping, and deciding what is ready for production is also sought.

Key Skills: Production ML Infrastructure, Systems Engineering, Agentic AI Systems, Distributed Systems, Kubernetes, Model Routing, LLM Provider Frameworks, Secure Code Execution, Identity and Authentication, Resource Management, State Management, Fault Tolerance, Storage Systems, Filesystem Abstractions, Code Execution Sandboxes, Productionization

Benefits & conditions

Benefits: Lunch Stipend, Health Insurance, Dental Insurance, Mental Health Benefits, RRSP Matching, 401(k), Pension Scheme, Paid Parental Leave, Annual Enrichment Benefits, Education and Learning Stipend, Paid Vacation, Travel Budget, Co-Working Benefit, Home Office Stipend #J-18808-Ljbffr

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.juju.com
Prepare application

Good distractions

Loading talks and stories from around this role…