> Markdown version of [/jobs/ext/4600889-engineering-manager-online-serving-and-inference-ai-platform](https://www.wearedevelopers.com/jobs/ext/4600889-engineering-manager-online-serving-and-inference-ai-platform). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Engineering Manager, Online Serving and Inference, AI Platform - **Company:** Netflix, Inc. - **Location:** Beverly Hills, CA, United States - **Experience:** Experienced - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Computer Vision, Data Cleansing, Distributed Systems, Machine Learning, Systems Development Life Cycle, Software Engineering, Large Language Models, Backend, AI Platforms, Kubernetes, Low Latency, SGLang, Machine Learning Operations, TensorRT, VLLM - **Published:** November 6, 2026 - **Apply:** https://www.careerbuilder.com/job-details/engineering-manager-online-serving-and-inference-ai-platform-beverly-hills-ca--4efc4b0f-79b9-4d48-8e66-e504c0766314 ## About the Role Engineering Management, Artificial Intelligence (AI), Storytelling, Leading Edge Technology, Machine Learning, Scalable System Development, Payment Processing, Artificial Intelligence (AI), Ecosystems, Computer Vision, * 10+ years of software engineering experience and 3+ years of management experience. * Experience leading teams responsible for building high-traffic distributed systems and ML infrastructure * Experience with containerization and orchestration technologies to support data preparation, processing, and inference for large-scale AI/ML models, such as Kubernetes. * Industry experience working with GPU based mode inference, and serving optimization (batching, latency, cost per request) in large scale computing environments * Modern Foundation Model, such as LLM, serving and inference stacks such as vLLM, Nvidia Triton, TensorRT LLM, or SGLang. * Strong technical acumen and can act as a credible technical advisor to the team, set and enforce a high-quality bar for code and system design, and be a mentor for the team. * A passion for translating the needs of ML practitioners into infrastructure offerings with an eye toward automated and self-serve capabilities. * Strong communication and collaboration skills and ability to build strong relationships with internal customers and external partners. * A demonstrated ability to develop, drive, and execute a technical vision and roadmap. * A track record of attracting top talent and leading and growing high-performance, diverse, and highly talented senior and staff level engineers to maximize their impact and deliver results in a fast-paced and dynamic environment. * Experience managing a hybrid team with partners and team members distributed across (US) geographies & time zones. ## Description Artificial Intelligence (AI) and Machine Learning (ML) power the innovation in all areas of the business, including helping members choose the right title for them through personalization, better understanding our audience and our content slate, creating high-quality subtitles, dubbings, images, trailers, and other assets, optimize our payment processing, and much more. The Artificial Intelligence (AIP) organization builds highly scalable and differentiated AI/ML infrastructure to maximize the business impact of all AI practitioners at Netflix, which is the key to accelerating this innovation. The Opportunity The Online Serving and Inference team builds and maintains the infrastructure that enables ML practitioners to run their large-scale online serving and inference workflows to deploy AI models for Netflix member scale ecosystems. The team is responsible for the common framework to develop and deploy AI/ML models in Netflix infrastructure to power the AI applications and features. We are looking for an experienced AI/ML infrastructure engineering leader to lead the development of our next-generation serving and inference platform! You will lead this team to architect, design, develop, test, and launch a brand-new platform to enable ML practitioners across the content, studio, consumer, ads, and games domains to effortlessly package, deploy, and execute inference workflows for thousands of large-scale models, including Large Language Models (LLMs), computer vision and foundation models. The models will come from various lifecycle stages, including early research and experimentation, development, productization, and ongoing innovation and optimization of productized models. We are a highly collaborative team. You will be highly cross-functional in partnering with other engineering, product management, machine learning, and data teams to take Netflix's AI initiatives to the next level. To succeed in this role, you will need a strong AI/ ML infrastructure background and a passion for building scalable, robust systems that enable and accelerate our ability to apply large and complex ML models across various domains. In this role, you will: * Partner with Applied Research and backend application teams to understand their needs and gather and iterate on the platform's requirements. * Drive the architecture, design, build vs. buy evaluation, and execution of the online serving and inference platform. Strive for extensibility and ensure the platform can scale to meet the needs of the evolving AI landscape. * Build a roadmap focused on incremental delivery. Define success metrics, align on migration goals, and drive the platform's adoption. * Communicate progress to stakeholders, customers, and senior leadership. * Maintain existing platform offerings, balancing immediate needs in current systems while prioritizing the development of the next-gen platform. * Hire and grow diverse, highly talented engineers while maintaining and fostering an inclusive team culture.