Senior Software Architect, AI Systems and Networking

• Architecting and implementing high-performance communication and memory management libraries for distributed AI
• Driving hardware-software co-optimization with GPU, DPU, NIC, and switch teams through GPUDirect RDMA, NVLink, and next-generation interconnects
• Profiling and optimizing data movement across GPU memory, system DRAM, NVMe, and network fabrics
• Integrating networking capabilities into AI serving stacks such as vLLM, SGLang, and TensorRT-LLM
• Contributing to and maintaining open-source projects, mentoring engineers, conducting design reviews, and prototyping experimental technologies to evaluate their viability

• 12+ years in systems software and/or networking with demonstrated ownership of complex projects.
• MS, PhD or equivalent experience in Computer Science, Computer Engineering, Electrical Engineering, or a related field.
• Solid understanding of high-performance networking: InfiniBand, RoCE, RDMA, NVLink, GPUDirect.
• Strong C/C++/Rust systems programming with comfort in performance profiling and low-level debugging.
• Understanding of ML systems concepts-transformer architectures, KV cache mechanics, model parallelism, or distributed training and inference patterns.

Ways to stand out from the crowd:

• Knowledge of ML inference frameworks (vLLM, SGLang, TensorRT-LLM) and their communication requirements.
• Knowledge of storage networking (NVMe-oF, GPUDirect Storage, S3).
• Background of Reinforcement Learning systems.

With competitive salaries and a comprehensive benefits package, NVIDIA is widely regarded as one of the most desirable technology employers in the world. Our teams are composed of some of the most forward-thinking and driven engineers in the industry, and we continue to grow rapidly. If you are a senior data engineer passionate about building large-scale, high-impact data platforms, we’d love to hear from you.

Your base salary will be determined based on your location, experience, and other objective job-related factors. The expected base salary ranges for this position are: 224,000 USD - 356,500 USD for Level 5; and 272,000 USD - 431,250 USD for Level 6.

You will also be eligible for equity and benefits.

An applied research team within NVIDIA’s Networking Systems & Software Architecture group is solving some of AI’s hardest infrastructure problems. The team builds systems-level software that moves data between GPUs, nodes, and storage at the speed modern AI demands-spanning low-level transport optimization, hardware-software co-design, and communication frameworks that plug directly into production AI stacks. The team’s charter expands into emerging domains including quantum computing interconnects.