Senior AI Platform Engineer

• Design and build agent runtime services for long-running, asynchronous and stateful AI workloads.
• Build model abstraction and routing capabilities that optimize quality, latency, reliability and cost across multiple AI providers and models.
• Implement tool invocation, execution state, retries, checkpoints, failure recovery and control mechanisms for production agents.
• Develop APIs and SDKs that let teams compose agentic workflows and reusable AI capabilities on top of AIVA.
• Build tracing, telemetry and evaluation into the runtime so agent behavior and outcomes can be measured and governed.
• Partner with security, identity, integration and platform engineers to safely expose enterprise systems and execution environments to agents.

• Strong software engineering and distributed-systems fundamentals, with experience building production platform services.
• Hands-on experience building production applications with LLMs, agents, tool/function calling or workflow orchestration.
• Experience with asynchronous execution, state management, queues/workflows, retries, observability and failure recovery.
• Understanding of model APIs, routing, structured outputs, context management and AI quality/cost tradeoffs.
• Cloud-native engineering experience with containers, APIs and secure production systems

We are a specialized technology staffing agency supporting professional and financial services companies. Why do we stand out in technology staffing? We listen and act as advisors for our candidates on how they can best add value, find interesting projects, and pave a path for career advancement. We advocate for the best pay, diversity in tech, and the best job fit for every candidate we place.

Our client, an investment firm, is seeking a Senior AI Platform Engineer to join their team in New York, NY!

AIVA is the firm’s governed AI execution platform, built to give engineers and business users a secure, scalable way to build and run AI enabled software and workflows in their controlled environments. The ideal candidate will build the execution layer behind AIVA’s agentic capabilities. You will design the runtime and platform services that allow AI agents to execute complex tasks for extended periods, interact with tools and enterprise systems, use the right model for the workload, recover from failures, and operate with the controls expected in a production enterprise environment. This is a software and distributed-systems role focused on agentic systems, not model training.