> Markdown version of [/jobs/ext/2071928-senior-manager-software-engineering-nim-factory](https://www.wearedevelopers.com/jobs/ext/2071928-senior-manager-software-engineering-nim-factory). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Manager, Software Engineering - NIM Factory - **Company:** NVIDIA Ltd. - **Location:** Santa Clara, CA, United States - **Experience:** Expert - **Salary:** $272,000.0 - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Cloud Computing, Computer Engineering, Continuous Integration, Python (Programming Language), Open Source Technology, Systems Development Life Cycle, Software Engineering, Large Language Models, Core Api, AI Platforms, Kubernetes, Information Technology, TensorRT, Nim (Programming Language), Microservices - **Published:** August 15, 2026 - **Apply:** https://www.juju.com/job/00000000gn53fs ## About the Role + 10+ overall years building and delivering production software systems, including 5+ years leading engineering teams as a manager; experience leading multiple teams or managing managers is a plus. + Proven track record driving complex, cross-functional programs from inception to successful production launch and scale. + Strong foundation in cloud-native engineering (containers, Kubernetes, microservices) and modern SDLC practices (CI/CD, testing, observability). + Proficiency with cloud languages such as Python; ability to read code, guide designs, and drive high-quality engineering outcomes. + Demonstrated ability to hire, coach, and develop senior engineers/tech leads; build inclusive teams and a culture of ownership and excellence. + Excellent communication and stakeholder management; ability to influence across product, research, security, and operations. + A degree in Computer Science, Computer Engineering, or a related field (BS or MS) or equivalent experience. Ways to stand out from the crowd: + Led teams that built and operated large-scale LLM inference or model-serving platforms (Triton, TensorRT-LLM, vLLM) in production. + Experience architecting next-generation container build systems or CI/CD platforms at scale. + Built organizations across multiple time zones; established durable engineering processes that improved quality and velocity. + Proven success building talent pipelines, mentoring managers/tech leads, and increasing team engagement and retention. + Contributions to open-source ecosystems, technical publications, or talks in containers, Kubernetes, GPU, or inference communities. We are widely considered to be one of the technology world's most desirable employers. We have some of the most forward-thinking and creative people in the world working for us. If you're creative and autonomous with a real passion for technology, we want to hear from you. ## Description NVIDIA is the platform upon which every new AI-powered application is built! We are seeking a deeply technical, hands-on Senior Engineering Manager to lead the NVIDIA Inference Microservices (NIM) Factory team. You will lead and scale a world-class engineering organization that delivers day-0 model launches and follows through with enterprise-grade software-to delight customers with reliable, performant, and secure AI services at massive scale. You will partner closely with product, research, SRE, and security to define strategy, drive execution across multiple workstreams, and safeguard the long-term technical health of the platform. What you'll be doing: + Lead the NIM Factory engineering team (containers, orchestration, workflow, observability, platform APIs); attract, hire, onboard, and grow top talent. + Define vision, strategy, and roadmap for how we build, ship, and operate NIM from day-0 launch through enterprise-grade hardening (security, reliability, performance, compliance). + Own end-to-end delivery of cross-functional programs; align stakeholders and manage dependencies. + Drive predictable delivery across multiple programs; manage priorities, resourcing, schedules, and dependencies ## Related Videos - [LLMOps-driven fine-tuning, evaluation, and inference with NVIDIA NIM & NeMo Microservices](https://www.wearedevelopers.com/videos/1582-llmops-driven-fine-tuning-evaluation-and-inference-with-nvidia-nim-nemo-microservices) - [Understanding Kubernetes in a visual way](https://www.wearedevelopers.com/videos/100085-understanding-kubernetes-in-a-visual-way) - [Tour de Force: Open-Source LLM Inference Optimization from Simple to Sophisticated](https://www.wearedevelopers.com/videos/100099-tour-de-force-open-source-llm-inference-optimization-from-simple-to-sophisticated) - [Insights from building the Canva Developers Platform to empower 185 million designers](https://www.wearedevelopers.com/videos/942-insights-from-building-the-canva-developers-platform-to-empower-185-million-designers) - [Efficient deployment and inference of GPU-accelerated LLMs​](https://www.wearedevelopers.com/videos/929-efficient-deployment-and-inference-of-gpu-accelerated-llms) - [Trends, Challenges and Best Practices for AI at the Edge](https://www.wearedevelopers.com/videos/630-trends-challenges-and-best-practices-for-ai-at-the-edge) ## Related Articles - [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development) - [MLOps – What’s the deal behind it?](https://www.wearedevelopers.com/magazine/125-mlops-what-s-the-deal-behind-it) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [Best US AI Conferences for CTOs in 2026: Build vs. Buy, Vendor Evaluation, and Peer Intelligence](https://www.wearedevelopers.com/magazine/736-best-us-ai-conferences-for-ctos-in-2026-build-vs-buy-vendor-evaluation-and-peer-intelligence) - [Stephan Gillich - Bringing AI Everywhere](https://www.wearedevelopers.com/magazine/489-stephan-gillich-bringing-ai-everywhere)