Senior Deep Learning Performance Architect

We are now looking for a Senior Deep Learning Performance Architect!

NVIDIA is seeking outstanding Performance Architects to help analyze and develop the next generation of architectures that accelerate AI and high-performance computing applications. Intelligent machines powered by Artificial Intelligence computers that can learn, reason and interact with people are no longer science fiction. GPU Deep Learning has provided the foundation for machines to learn, perceive, reason and solve problems. NVIDIA's GPUs run AI algorithms, simulating human intelligence, and act as the brains of computers, robots and self-driving cars that can perceive and understand the world. Come, join our Deep Learning Architecture team, where you can help build real-time, cost-effective computing platforms driving our success in this exciting and rapidly growing field!

What you'll be doing

• Design and evaluate hardware architectures to improve performance, efficiency, and scalability of production AI workloads.
• Analyze and optimize large-scale deep learning workloads, especially LLM inference/training in real-world deployments.
• Build and use performance and power models (Python/C++) to drive architecture and product decisions.
• Identify and resolve system bottlenecks across compute, memory, and interconnect.
• Evaluate PPA trade-offs and guide feature prioritization for next-generation GPU/ASIC designs.
• Partner closely with software, systems, and product teams to align hardware capabilities with workload requirements.

• MS or PhD in a relevant field (Computer Science, Electrical Engineering, Computer Engineering, etc) or equivalent experience.
• 5+ years of hands-on experience in GPU/ASIC architecture, parallel computing, or system performance engineering.
• Experience with deep learning workloads in production environments (training and/or inference).
• Proficiency in Python and C++ for building performance models, simulators, or analysis tools.
• Solid understanding of system architecture: memory hierarchy, data movement, and scalability.
• Prior experience debugging, profiling, and performance tuning on real systems.
• Ability to work across team and drive decisions in fast-paced product environments.

Ways to stand out from the crowd:

• Experience translating workload behavior into concrete hardware or system-level improvements.
• Practical experience with LLM inference optimization: batching, disaggregation, KV-cache management, latency/throughput tuning.
• Familiarity with production inference systems (e.g., scheduling, multi-node scaling, resource utilization)

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 184,000 USD - 287,500 USD for Level 4, and 224,000 USD - 356,500 USD for Level 5.