> Markdown version of [/jobs/ext/4629838-sr-engineering-manager-ai-platform](https://www.wearedevelopers.com/jobs/ext/4629838-sr-engineering-manager-ai-platform). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Sr. Engineering Manager, AI Platform

- **Company:** Illumio
- **Location:** San Jose, CA, United States
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Java (Programming Language), Application Programming Interfaces (APIs), Artificial Intelligence, Amazon Web Services, Microsoft Azure, Cloud Database, Cloud Engineering, Cyber Security, Distributed Systems, Python (Programming Language), Inference Optimization, Cloud Services, Software Engineering, AI Infrastructure, Google Cloud, Spring Cloud, Retrieval-Augmented Generation, Large Language Models, Multi-Agent Systems, Prompt Engineering, Model Validation, Core Api, Backend, Langfuse — LLM Observability and Analytics Platform, Agentic-AI, Event Driven Architecture, Containerization, AI Platforms, Kubernetes, Apache Kafka, Machine Learning Operations, Terraform, Golang, Microservices
- **Published:** November 7, 2026
- **Apply:** https://www.juju.com/job/28_25304_b9bff69b88117cf5ab44e437b38c685e

## About the Role

* 10+ years building distributed and scalable backend systems.
 * 3+ years leading software engineering teams and engineering leads/managers.
 * Strong experience in Java, Go, Python, or equivalent backend technologies.
 * Deep expertise with microservices, APIs, cloud-native architectures, Kubernetes, and containerized workloads.
 * Experience building high-scale distributed systems and event-driven architectures leveraging technologies such as Kafka.
 * Practical understanding of modern AI systems, including LLMs, AI agents, RAG architectures, model serving, prompt engineering, and agent orchestration frameworks.
 * Experience partnering with Product Management to define strategy and deliver customer-facing capabilities.
 * Strong communication skills and the ability to influence technical direction across organizations.
 * Experience operating services in production with a focus on telemetry, monitoring, and reliability.

Bonus Points

 * Experience leading AI Platform, ML Infrastructure, or Agentic Systems teams.
 * Hands-on knowledge of vector databases, inference optimization, model evaluation frameworks, and AI observability platforms such as Langfuse.
 * Security or cybersecurity domain experience.
 * Experience building enterprise SaaS platforms at scale.
 * Familiarity with Terraform, cloud automation, and Infrastructure-as-Code.

This position involves access to software/technology that is subject to U.S. export controls. Any job offer made will be contingent upon the applicant's capacity to serve in compliance with U.S. export controls.

## Description

* Lead and grow a team of backend engineers building highly scalable cloud services and AI-powered platform capabilities.
 * Drive technical strategy and execution for distributed systems, platform APIs, and AI-enabled services.
 * Partner closely with Product, Security, Infrastructure, and Data Science teams to deliver intelligent platform experiences.
 * Define architecture for large-scale microservices, event-driven systems, and cloud-native applications.
 * Help shape Illumio's AI roadmap, including agentic workflows, LLM integrations, RAG architectures, and AI infrastructure.
 * Establish engineering best practices around reliability, observability, scalability, security, and operational excellence.
 * Mentor engineering managers and senior engineers while fostering a culture of ownership and innovation.
 * Drive quarterly planning, staffing strategy, technical roadmaps, and architectural reviews.
 * Ensure successful delivery of highly available services running across AWS, Azure, and GCP environments.