> Markdown version of [/jobs/ext/259197-sr-tech-product-manager-neuron-runtime-and-cloud-ml-infrastructure-annapurna-labs](https://www.wearedevelopers.com/jobs/ext/259197-sr-tech-product-manager-neuron-runtime-and-cloud-ml-infrastructure-annapurna-labs). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Sr. Tech Product Manager - Neuron Runtime and Cloud ML Infrastructure, Annapurna Labs - **Company:** Annapurna Labs - **Location:** Seattle, WA, United States - **Experience:** Expert - **Salary:** $151,200.0 - $204,600.0 - **Contract:** Permanent contract - **Skills:** Application Programming Interfaces (APIs), Amazon Web Services, Cloud Computing, Profiling, Code Review, Software Debugging, Linux, Programming Tools, Device Drivers, Distributed Computing Environment, Distributed Systems, Linux Kernel, Linux Distribution, Open Source Technology, Performance Tuning, Software Product Management, Remote Direct Memory Access, Tensorflow, Software Engineering, Computer Network Technologies, Pytorch, Deep Learning, Parallel Computation, Scikit Learn, Kubernetes, Performance Monitor, Slurm, Machine Learning Operations, Databricks - **Published:** May 19, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=a853f39e247fc7f3 ## About the Role The ideal candidate can balance competing customer priorities and drive alignment across engineering and business stakeholders in a fast-moving, early-stage product environment, with excellent written and verbal communication abilities. The ideal candidate has experience with: * Technical product management for developer-facing runtime and infrastructure products * Developer tools (SDKs, libraries, APIs) with focus on developer experience * Resource management and orchestration systems (SLURM, Kubernetes schedulers) * ML monitoring, observability, and resilience * Distributed systems and high-performance computing (HPC) environments * AWS cloud services and infrastructure About AWS Neuron AWS Neuron is the software stack for running deep learning and generative AI workloads on AWS Trainium and AWS Inferentia. It includes a compiler, runtime, training and inference libraries, and developer tools for monitoring, profiling, and debugging. Built on an open source foundation, Neuron supports native PyTorch and JAX frameworks and popular ML libraries without code modification. Neuron enables rapid experimentation, distributed training across multiple chips and nodes, and cost-optimized inference powered by optimized kernels. For performance optimization, Neuron provides the Neuron Kernel Interface (NKI) for direct hardware access and a suite of profiling and debugging tools., * Bachelor's degree or above in computer science, engineering, analytics, mathematics, statistics, IT or equivalent * 7+ years of industry experience with at least 5+ years in Technical product management and 3+ years of software development * Experience with technical product management for developer-facing products * Experience with resource management and orchestration systems (such as SLURM and Kubernetes schedulers), including monitoring, observability, and resilience * Excellent written and verbal communication abilities, * Distributed computing and parallel processing, Collective communication libraries (NCCL, MPI) and communication patterns (all-reduce, all-gather, reduce-scatter) * Experience with Linux systems, kernel development, and device drivers * Deep learning model training and inference deployments at scale; Container orchestration (Kubernetes), computer architecture fundamentals * Developer tools (SDKs, libraries, APIs) with focus on developer experience * Track record of driving developer libraries, open standards, and ecosystem integration * High-performance networking technologies (RDMA, EFA) ## Description AWS Neuron is hiring a Technical Product Manager to work backward from Trainium customers and drive the developer experience for running high-performance ML workloads at scale on AWS Trainium, from getting started with Neuron Deep Learning Containers, AMIs, and AWS services to operating at scale through orchestration, resiliency, and observability. You will drive the product strategy for how developers interact with Trainium through container ecosystems, resource management platforms, and AWS services. This includes Neuron integration with orchestration tools (SLURM, Kubernetes), AWS services (EKS, SageMaker), Neuron Deep Learning Containers and AMIs, and Linux distribution support. You will also drive the strategy for resiliency and observability tools that enable system diagnostics, performance monitoring, health monitoring, automated recovery, and telemetry, allowing customers to operate AI training and inference workloads with maximum uptime and efficiency, as well as how Neuron Runtime System interacts with ML frameworks to ensure scale and high performance execution of models. To be successful in this role, you will partner with engineering teams and PMs responsible for training, inference, and performance tools, Marketing, Business Development, and Solution Architects supporting customers, and develop deep knowledge and understanding of Trainium Architecture and Neuron Runtime System (including Neuron Runtime Library, Neuron Kernel Driver and Collective Communication Stack) to effectively define product strategy and make informed technical decisions., Product Strategy & Vision: Own product strategy and roadmap. Guide trade-offs between performance, scalability, and developer experience. Write PRFAQs and PRDs. Customer Discovery: Understand deployment challenges, orchestration needs, and infrastructure pain points. Represent customer needs in executive prioritization. Technical Leadership: Drive alignment across Neuron components (Runtime, Kernel Driver, Collective Communication, container infrastructure) and AWS services. Partner with training, inference, and performance PMs. Write user stories and define success metrics. Impact: Enable customers (Anthropic, Databricks, AWS teams) to deploy, monitor, and operate ML workloads at scale through container orchestration, resource management, health monitoring, and observability. About the team Our team is dedicated to supporting new members. We have a broad mix of experience levels and tenures, and we're building an environment that celebrates knowledge-sharing and mentorship. Our senior members enjoy one-on-one mentoring and thorough, but kind, code reviews. We care about your career growth and strive to assign projects that help our team members develop your engineering expertise so you feel empowered to take on more complex tasks in the future. ## Related Videos - [Running Secure Life Science Research at Scale using Hybrid GPU HPC and Kubernetes 🧬](https://www.wearedevelopers.com/videos/100355-running-secure-life-science-research-at-scale-using-hybrid-gpu-hpc-and-kubernetes) - [LLMOps-driven fine-tuning, evaluation, and inference with NVIDIA NIM & NeMo Microservices](https://www.wearedevelopers.com/videos/1582-llmops-driven-fine-tuning-evaluation-and-inference-with-nvidia-nim-nemo-microservices) - [Photonic Computing: Programming a New Class of AI Accelerators (incl. Live Coding)](https://www.wearedevelopers.com/videos/100196-photonic-computing-programming-a-new-class-of-ai-accelerators-incl-live-coding) - [Docker network without Docker](https://www.wearedevelopers.com/videos/1418-docker-network-without-docker) - [Making neural networks portable with ONNX](https://www.wearedevelopers.com/videos/301-making-neural-networks-portable-with-onnx) - [Geometric deep learning for drug discovery](https://www.wearedevelopers.com/videos/264-geometric-deep-learning-for-drug-discovery) ## Related Articles - [Best US AI Conferences for CTOs in 2026: Build vs. Buy, Vendor Evaluation, and Peer Intelligence](https://www.wearedevelopers.com/magazine/736-best-us-ai-conferences-for-ctos-in-2026-build-vs-buy-vendor-evaluation-and-peer-intelligence) - [Everything a Developer Needs to Know About MCP with Neo4j](https://www.wearedevelopers.com/magazine/604-everything-a-developer-needs-to-know-about-mcp-with-neo4j) - [MLOps – What’s the deal behind it?](https://www.wearedevelopers.com/magazine/125-mlops-what-s-the-deal-behind-it) - [MLops – Deploying, Maintaining And Evolving Machine Learning Models in Production](https://www.wearedevelopers.com/magazine/115-mlops-deploying-maintaining-and-evolving-machine-learning-models-in-production) - [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development) - [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers)