> Markdown version of [/jobs/ext/1338530-staff-software-engineer-ai-platform](https://www.wearedevelopers.com/jobs/ext/1338530-staff-software-engineer-ai-platform). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Staff Software Engineer, AI Platform - **Company:** Harvey, Inc. - **Location:** New York, NY, United States - **Salary:** $231,000.0 - $340,000.0 - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Programming Tools, Distributed Systems, Machine Learning, Routing, Systems Integration, Backend, Build Management, AI Platforms - **Published:** July 18, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=003beed1f6f7438e ## About the Role * 8+ years of experience building backend systems, with at least 1+ year focused on AI/ML engineering and a track record of technical leadership across teams. * Experience building and shipping multi-model or multi-provider AI systems in production. * Familiarity with context management, session state, or memory systems in AI or distributed systems. You've thought about what the model sees and why it matters. * A track record of building internal platforms, SDKs, or shared infrastructure that other engineering teams actually adopted - and an understanding of why developer experience matters as much as raw capability. * Strong judgment about abstractions. Opinionated about good design but pragmatic about shipping incrementally. * Excitement about agentic AI and the infrastructure challenges of making autonomous systems reliable when the stakes are real. * A bias toward full ownership: you navigate ambiguity well and don't wait for a roadmap to start solving problems. * Bonus: experience building evaluation frameworks, working with agent/function-calling architectures, familiarity with legal or other high-stakes professional services domains, or time at early-stage or hyper-growth startups where the underlying technology changes regularly. ## Description * Context Engineering & Agent Infrastructure. Build the platform-level systems for context management, session state, and memory that all of Harvey's agents and products rely on. * Model Integration & Routing. Own the infrastructure that lets Harvey onboard new foundation models fast and route to the right one for every task - a capability every product team depends on. * Evaluation Infrastructure. Build the shared eval tooling and frameworks that let every team across Harvey measure and improve AI quality systematically. * Shared Abstractions. Create the SDKs, platform primitives, and developer tooling that make it dramatically easier for product teams to ship AI-powered features., * Design and build abstractions and platform-level systems that improve all of Harvey's agentic products. * Own infrastructure for model integration, routing, and evaluation that helps Harvey choose and deploy the right foundation model for any given context. * Build evaluation frameworks and tooling that let every team across Harvey iterate on AI quality effectively. * Partner closely with product engineering teams, PMs, and design to launch cutting-edge AI products. * Evaluate, prototype, and integrate the latest advancements in AI and agentic systems as they emerge. ## Related Videos - [The New Org Chart: When AI Joins the Workforce](https://www.wearedevelopers.com/videos/100036-the-new-org-chart-when-ai-joins-the-workforce) - [Creating a routing app with Google Maps API from scratch](https://www.wearedevelopers.com/videos/831-creating-a-routing-app-with-google-maps-api-from-scratch) - [Developing the Backend with Stefan Lingler, CTO at Shpock](https://www.wearedevelopers.com/videos/100360-developing-the-backend-with-stefan-lingler-cto-at-shpock) - [This App Reached 10,000 Users in One Week. Here's How.](https://www.wearedevelopers.com/videos/100329-this-app-reached-10-000-users-in-one-week-here-s-how) - [Nest.js - TypeScript in the backend can also be clean](https://www.wearedevelopers.com/videos/1033-nest-js-typescript-in-the-backend-can-also-be-clean) - [Shipping Faster with Less: Render on Cloud Hosting, AI Workloads, and the Future of DevOps](https://www.wearedevelopers.com/videos/1894-shipping-faster-with-less-render-on-cloud-hosting-ai-workloads-and-the-future-of-devops) ## Related Articles - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift) - [What is Software Engineering in the Age of AI?](https://www.wearedevelopers.com/magazine/640-what-is-software-engineering-in-the-age-of-ai) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [What is Agentic Programming and Why Should Developers Care?](https://www.wearedevelopers.com/magazine/625-what-is-agentic-programming-and-why-should-developers-care) - [Will AI replace Software Engineers?](https://www.wearedevelopers.com/magazine/340-will-ai-replace-software-engineers)