> Markdown version of [/jobs/ext/2445520-senior-product-manager-ai-platform-inference](https://www.wearedevelopers.com/jobs/ext/2445520-senior-product-manager-ai-platform-inference). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Senior Product Manager - AI Platform Inference

- **Company:** NVIDIA Ltd.
- **Location:** Santa Clara, CA, United States
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Computer Engineering, Machine Learning, Performance Tuning, Software Product Management, Software Deployment, Software Engineering, Graphics Processing Unit (GPU), Large Language Models, AI Platforms, Information Technology, TensorRT
- **Published:** August 4, 2026
- **Apply:** https://us.experteer.com/career/view-jobs/senior-product-manager-ai-platform-inference-santa-clara-ca-usa-58815165

## About the Role

Experteer Overview In this role you drive the product vision and execution for AI platform inference on NVIDIA GPUs. You collaborate with developers across the ecosystem to accelerate deployments and optimize performance. You shape roadmaps, strategy, and go-to-market plans to help developers build better inference deployments at scale. Your work enables NVIDIA to lead in AI deployment tooling and open opportunities for innovation and impact in GenAI workloads. Compensation / Benefits * Create products that help developers build better Inference deployments * Develop product strategy, roadmaps, and go-to-market plans * Collaborate with internal and external developers to build roadmaps for model optimization software * Align with leadership to drive the company strategy Tasks * Experience with Inference deployment and optimization software (e.g., vLLM, SGLang, FlashInfer, TensorRT-LLM, Triton, Dynamo, TorchAO) * Demonstrable knowledge of GenAI or ML concepts, particularly performance
optimization and software development/delivery * BS or MS in Computer Science, Computer Engineering, or equivalent experience * 6+ years of technical product management experience at a technology company * Strong communication and interpersonal skills Key requirements * equity * benefits

## Description

Experteer Overview In this role you drive the product vision and execution for AI platform inference on NVIDIA GPUs. You collaborate with developers across the ecosystem to accelerate deployments and optimize performance. You shape roadmaps, strategy, and go-to-market plans to help developers build better inference deployments at scale. Your work enables NVIDIA to lead in AI deployment tooling and open opportunities for innovation and impact in GenAI workloads. Compensation / Benefits * Create products that help developers build better Inference deployments * Develop product strategy, roadmaps, and go-to-market plans * Collaborate with internal and external developers to build roadmaps for model optimization software * Align with leadership to drive the company strategy Tasks * Experience with Inference deployment and optimization software (e.g., vLLM, SGLang, FlashInfer, TensorRT-LLM, Triton, Dynamo, TorchAO) * Demonstrable knowledge of GenAI or ML concepts, particularly performance optimization and software development/delivery * BS or MS in Computer Science, Computer Engineering, or equivalent experience * 6+ years of technical product management experience at a technology company * Strong communication and interpersonal skills Key requirements * equity * benefits


## Related Videos

- [Efficient deployment and inference of GPU-accelerated LLMs​](https://www.wearedevelopers.com/videos/929-efficient-deployment-and-inference-of-gpu-accelerated-llms)
- [Tour de Force: Open-Source LLM Inference Optimization from Simple to Sophisticated](https://www.wearedevelopers.com/videos/100099-tour-de-force-open-source-llm-inference-optimization-from-simple-to-sophisticated)
- [Introduction to Azure Machine Learning](https://www.wearedevelopers.com/videos/368-introduction-to-azure-machine-learning)
- [This App Reached 10,000 Users in One Week. Here's How.](https://www.wearedevelopers.com/videos/100329-this-app-reached-10-000-users-in-one-week-here-s-how)
- [Trends, Challenges and Best Practices for AI at the Edge](https://www.wearedevelopers.com/videos/630-trends-challenges-and-best-practices-for-ai-at-the-edge)
- [From AI Assistance to Agentic Systems: Scaling Sovereign AI in Banking](https://www.wearedevelopers.com/videos/100070-from-ai-assistance-to-agentic-systems-scaling-sovereign-ai-in-banking)

## Related Articles

- [Stephan Gillich - Bringing AI Everywhere](https://www.wearedevelopers.com/magazine/489-stephan-gillich-bringing-ai-everywhere)
- [MLOps – What’s the deal behind it?](https://www.wearedevelopers.com/magazine/125-mlops-what-s-the-deal-behind-it)
- [Best US AI Conferences for CTOs in 2026: Build vs. Buy, Vendor Evaluation, and Peer Intelligence](https://www.wearedevelopers.com/magazine/736-best-us-ai-conferences-for-ctos-in-2026-build-vs-buy-vendor-evaluation-and-peer-intelligence)
- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)
- [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development)
- [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud)