Senior Product Architect, K8s-Based AI Infrastructure

NVIDIA is the engine of modern Artificial Intelligence, Parallel Compute Infrastructure, and Agentic AI - the biggest technology breakthroughs of our time. We’re on a mission to redefine how data moves, connects, and accelerates workloads at scale, and we’re seeking a visionary Product Architect with strong expertise in systems architecture to join our cause. As a key member of our team, you’ll design and shape the architectures that connect the world’s most powerful AI clusters. As a Product Architect at NVIDIA, you’ll be the linchpin in transforming ideas into well-defined, functional products, balancing technical feasibility with user needs and market demands. You’ll be responsible for designing and overseeing the development of cutting-edge AI solutions from conception through their entire lifecycle. Working at NVIDIA is all about efficiency and multiplying efforts; being a Product Architect is at the nexus of this ethos!

What you’ll be doing:

• Stay at the forefront of technology trends in AI Infrastructure & Agentic AI, proposing new product concepts
• Define detailed product architectures, including performance, scalability, interoperability, and datacenter deployment requirements
• Lead prototyping and testing processes to validate product design and functionality, with a focus on scale, diagnosing bottlenecks and driving innovations in performance
• Iterate and refine designs based on feedback, testing results, and evolving requirements
• Collaborate with internal hardware, software, security and systems teams to ensure flawless integration of networking, compute and storage ecosystems
• Work closely with partners and customers to conceptualize ideal solutions, build proof-of-concepts (POCs) and minimum viable products (MVPs) that demonstrate your vision
• Provide comprehensive documentation for product designs, including technical specifications and user guides
• Develop targeted content such as whitepapers, blogs, and curriculum for customers, partners, and users

• 8+ years of experience architecting datacenter-scale HPC or AI infrastructure as a Principal Architect, Solutions Architect, Principal Engineer, or equivalent
• Bachelors degree in computer science or related field (or equivalent experience).
• Strong background in technologies that enable large scale infrastructure management of complex systems, networks, and storage
• Extensive experience with DevOps solutions, including Python, Ansible, Container Runtimes, Kubernetes, and data center deployments
• Familiarity with AI workloads, including agentic & RAG-based workflows, inference at scale, large scale training & fine-tuning, and model evaluation
• Exceptional communication skills, with the ability to translate complex technical details for diverse audiences
• A passion for staying updated with the latest technological advancements in AI and related fields

Ways to stand out from the crowd:

• Prior first-hand experience on having built large scale AI infrastructure
• Advanced certifications or publications in AI, deep learning, or related fields
• Experience leading high-impact projects or initiatives in cutting-edge tech domains

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 184,000 USD - 287,500 USD for Level 4, and 224,000 USD - 356,500 USD for Level 5.

NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us. If you’re creative and autonomous, we want to hear from you!