> Markdown version of [/jobs/ext/4323034-principal-deep-learning-communication-architect](https://www.wearedevelopers.com/jobs/ext/4323034-principal-deep-learning-communication-architect). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Principal Deep Learning Communication Architect

- **Company:** NVIDIA Corporation
- **Location:** Santa Clara, CA, United States
- **Salary:** $272,000.0
- **Contract:** Permanent contract
- **Skills:** Artificial Intelligence, Nvidia CUDA, Computer Programming, Ethernet, InfiniBand, Remote Direct Memory Access, Graphics Processing Unit (GPU), DeepSpeed, Large Language Models, Deep Learning, Parallel Computation, Agentic-AI, Information Technology, SGLang, TensorRT, VLLM, Megatron, KServe
- **Published:** October 31, 2026
- **Apply:** https://nvidia.wd5.myworkdayjobs.com/NVIDIAExternalCareerSite/job/US-CA-Santa-Clara/Principal-Deep-Learning-Communication-Architect_JR2015200

## About the Role

* Ph.D. or M.S. in Computer Science, Electrical Engineering, or a related field (or equivalent experience), with 12+ years of industry experience in high-performance computing (HPC) or distributed deep learning.
 * Parallelism Expertise: Deep understanding of 3D parallelism (Data, Tensor, Pipeline) and advanced strategies including Context Parallelism, Expert Parallelism, and Zero Redundancy Optimizer (ZeRO) variants.
 * Technical Proficiency: Deep technical proficiency with NCCL, UCX, UCC, NVSHMEM, or MPI. Experience with RDMA, RoCE, and low-level InfiniBand verbs is required.
 * Inference & Serving: Advanced knowledge of high-throughput inference engines and schedulers, specifically TensorRT-LLM, vLLM, SGLang, and NVIDIA Dynamo.
 * GPU Architecture: Expert knowledge of the NVIDIA GPU memory hierarchy (HBM3e/HBM4, L2 cache) and CUDA programming models.

Ways to Stand Out from the Crowd:

 * Framework Development: Hands-on experience developing within Megatron-Core, DeepSpeed, or JAX/XLA, with an understanding of how these frameworks interact with low-level communication runtimes is a plus.
 * Significant upstream contributions to major open-source projects (e.g., PyTorch Distributed, KServe, or Ray).
 * A proven track record of deploying and optimizing models on NVIDIA platforms or similar rack-scale systems.
 * A strong portfolio of patents or papers in top-tier systems/architecture venues (e.g., ISCA, ASPLOS, NeurIPS, SC).

## Description

* Architecture Leadership: Define the long-term technical roadmap for communication libraries across NVIDIA's next-generation platforms. You will ensure the seamless scaling of models to clusters comprising hundreds of thousands of nodes.
 * AI Communication Library Design: Lead the development of next-generation communication primitives and collective algorithms. This includes optimizing for heterogeneous interconnects such as NVLink, Spectrum-X (Ethernet), and Quantum-X (InfiniBand).
 * Application- Communication Library Co-Design: Partner with application developers to architect and implement specialized communication primitives. You will ensure that AI and HPC libraries-including NCCL, NIXL, NVSHMEM, UCC, and UCX-evolve to meet the requirements of trillion-parameter and Agentic AI.
 * Hardware/Software Co-Design: Collaborate with silicon Aarchitects and software engineers to influence hardware specifications for next-generation networking, ensuring they meet the evolving demands of trillion-parameter LLMs and Agentic AI.
 * Quantitative Modeling: Develop high-fidelity analytical models and simulators to predict system behavior under emerging workloads.