> Markdown version of [/jobs/ext/1180953-staff-backend-ai-platform-engineer](https://www.wearedevelopers.com/jobs/ext/1180953-staff-backend-ai-platform-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Staff Backend AI Platform Engineer - **Company:** Freshworks Inc - **Location:** San Mateo, CA, United States - **Experience:** Starter - **Salary:** $225,000.0 - $278,000.0 - **Contract:** Permanent contract - **Skills:** Java (Programming Language), Application Programming Interfaces (APIs), Artificial Intelligence, Airflow, Amazon Web Services, Automation of Tests, Software as a Service, Cloud Computing, Cloud Engineering, Code Review, Computer Programming, Data as a Services, Distributed Systems, Memory Management, High-Level Architecture, PostgreSQL, Enterprise Messaging Systems, OAuth, Open Source Technology, Performance Tuning, Role-Based Access Control, Azure Machine Learning, Single Sign-On, Systems Architecture, Systems Integration, Workflow Management Systems, Large Language Models, Multi-Agent Systems, Backend, Event Driven Architecture, Build Management, AI Platforms, Kubernetes, Apache Kafka, Virtual Agents, Restful APIs, Terraform, Data Pipelines, Microservices - **Published:** July 4, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=ecb1a1698d63a1c0 ## About the Role * 6+ years of backend engineering experience. * 1-2+ years of hands-on experience in AI/ML platform development. * Expert Proficiency: Strong programming skills in Java and Python. * Framework Expertise: Hands-on experience with LangChain, LangGraph, or LangSmith. * Distributed Systems: Deep understanding of event-driven architectures, microservices, and Kubernetes. * Cloud & Data: Solid experience with AWS, Terraform, and a mix of relational (PostgreSQL) and Vector databases. * Orchestration: Practical experience with workflow engines like Temporal or Airflow and messaging systems like Kafka., * Experience with AI-driven planning systems or dialog state tracking. * Background in enterprise security (RBAC, SSO, OAuth2). * Experience working in a high-growth SaaS or startup environment. * Active contributions to open-source backend or AI frameworks. ## Description We are seeking a Backend AI Platform Engineer to lead the development of core backend services powering our Agentic AI Platform. In this role, you will be the primary technical driver for building reasoning-driven agents, multi-agent orchestration, and outcome-based workflows. You will collaborate with the Principal AI Architect to bridge the gap between high-level design and scalable implementation. You will own the development of high-performance APIs and orchestration runtimes, integrating frameworks like LangChain, LangGraph, and LangSmith. This role is highly hands-on and requires a technical leader who can navigate a fast-paced environment while maintaining high engineering standards., Platform Backend Development * Lead Implementation: Act as the lead engineer for agent runtime orchestration services, focusing on reasoning, planning, and tool invocation. * API & SDK Design: Own the development of robust APIs and SDKs that enable internal and external teams to build and deploy agent workflows. * State & Memory Management: Build and optimize stateful dialog management and memory services for multi-turn, context-aware agents. * Agent Communication: Implement multi-agent communication (A2A) protocols and shared context systems. System Architecture & Execution * Microservices Leadership: Execute the transition to cloud-native, event-driven backend services using microservices or service mesh architectures. * Workflow Design: Build and manage task scheduling and long-running operations using tools like Temporal or Airflow. * Performance Optimization: Optimize LLM orchestration for performance and cost through caching, batching, and token monitoring. Integrations & Data Services * Data Pipeline Ownership: Implement and maintain RAG pipelines and integrations with vector databases (e.g., Pinecone, Weaviate, FAISS). * Telemetry Integration: Ensure all backend services support LangSmith-based evaluation and comprehensive observability. Security & Reliability * Tenant Isolation: Implement RBAC, API authentication, and multi-tenant isolation logic. * Engineering Excellence: Set the standard for automated testing (unit, integration, load) and implement OpenTelemetry for full system visibility. * Mentorship: Provide technical guidance and code reviews for more junior backend engineers on the team. ## Related Videos - [Inside Bitpanda's Tech Stack: Scaling a European Fintech Leader - Markus Dorner](https://www.wearedevelopers.com/videos/1979-inside-bitpanda-s-tech-stack-scaling-a-european-fintech-leader-markus-dorner) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Keeping applications secure by evolving OAuth 2.0 and OpenID Connect](https://www.wearedevelopers.com/videos/100152-keeping-applications-secure-by-evolving-oauth-2-0-and-openid-connect) - [Developing the Backend with Stefan Lingler, CTO at Shpock](https://www.wearedevelopers.com/videos/100360-developing-the-backend-with-stefan-lingler-cto-at-shpock) - [Building a Multi-Agent Orchestration Engine That Actually Follows the Rules](https://www.wearedevelopers.com/videos/100159-building-a-multi-agent-orchestration-engine-that-actually-follows-the-rules) - [AI Model Management Life Circles: ML Ops For Generative AI Models From Research to Deployment](https://www.wearedevelopers.com/videos/1152-ai-model-management-life-circles-ml-ops-for-generative-ai-models-from-research-to-deployment) ## Related Articles - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift) - [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development) - [From Prototype to Production: Build AI Agents with This Free 4-Course Learning Path](https://www.wearedevelopers.com/magazine/655-from-prototype-to-production-build-ai-agents-with-this-free-4-course-learning-path) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production)