> Markdown version of [/jobs/ext/596175-principal-network-architect-ai-infrastructure](https://www.wearedevelopers.com/jobs/ext/596175-principal-network-architect-ai-infrastructure). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Principal Network Architect- AI Infrastructure - **Company:** NSCALE, LLC - **Location:** San Francisco, CA, United States - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Application Layers, Border Gateway Protocol, Computer Clusters, Communications Protocols, Computer Programming, Network Congestion, Software Debugging, Distributed Systems, Firmware, Monitoring of Systems, InfiniBand, Python (Programming Language), Routing, Open Shortest Path First (OSPF), Performance Tuning, Systems Development Life Cycle, Remote Direct Memory Access, Systems Architecture, AI Infrastructure, Scripting, Computer Networking Systems, Computer Network Operations, Data Center Networking - **Published:** June 19, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=8cf182efb4d26c78 ## About the Role Core Experience * 10+ years of experience in network engineering in hyperscale, AI, or HPC environments * Deep expertise in RDMA, Infiniband, and/or large-scale RoCE fabrics * Strong understanding of: * RDMA internals and performance tuning * Congestion control and fabric failure modes * Distributed system communication patterns Technical Skills * Expert-level knowledge of data center networking protocols (BGP, OSPF, ECMP) * Proven ability to debug multi-layer issues across network, system, and application layers * Strong programming/scripting skills for automation (Python, Go, etc.) * Experience designing high-scale, highly available network systems Leadership & Impact * Demonstrated ability to lead complex technical programs without direct authority * Experience acting as a senior escalation point for critical production issues * Strong ability to drive cross-team alignment and execution * Systems-level thinking balancing performance, reliability, scalability, and cost Nice to Have * Experience with NVIDIA / Mellanox networking platforms * Familiarity with distributed AI training frameworks and GPU communication patterns * Experience building network observability systems at scale * Background influencing infrastructure strategy in high-growth environments ## Description Nscale is seeking a Network Architect Engineer to lead the evolution, reliability, and operational excellence of our global AI networking infrastructure. This role sits at the core of Nscale's platform, where network performance directly impacts AI training outcomes. You will act as a technical authority across large-scale RDMA / Infiniband / RoCE fabrics, driving automation, availability improvements, and system-level design across a globally distributed GPU cloud. You will combine deep network protocol-level networking expertise with strong software and automation skills to operate and scale one of the most demanding AI networking environments in the industry. What You'll Do Technical Leadership & Strategy * Own the technical direction and operational lifecycle management of Nscale's high-performance RDMA network fabrics * Define long-term architecture, reliability strategy, and operational standards for AI interconnect networks * Lead availability and performance improvement initiatives across globally distributed GPU clusters * Act as a technical authority (SME) across networking, influencing platform-wide decisions Network Engineering & Operations * Support design, build, and evolve large-scale Infiniband and RoCE fabrics * Drive deep debugging and resolution of complex cross-layer issues (hardware, firmware, kernel, distributed workloads) * Lead incident response and postmortems, ensuring systemic fixes and long-term improvements * Define and enforce standards across: * Congestion control and traffic engineering * Routing (BGP, ECMP, fabric-level routing strategies) * Firmware lifecycle and change management * Network observability and telemetry Automation & Systems Development * Develop and scale automation frameworks for network provisioning, validation, and operations * Build tooling to support high-reliability, low-touch network operations at scale * Improve operational efficiency across hundreds of thousands of endpoints and high-throughput links Cross-Functional Leadership * Lead complex technical initiatives across Network, SRE, Compute, and Platform teams * Serve as technical lead on critical programs, coordinating engineers and stakeholders * Influence product and infrastructure roadmaps based on operational insights and customer needs * Mentor senior engineers and raise the bar for technical rigor and execution ## Related Videos - [Building the Nervous System of AI - Michael Kagan (NVIDIA)](https://www.wearedevelopers.com/videos/2133-building-the-nervous-system-of-ai-michael-kagan-nvidia) - [Creating a routing app with Google Maps API from scratch](https://www.wearedevelopers.com/videos/831-creating-a-routing-app-with-google-maps-api-from-scratch) - [JavaScript? No. Java Scripts! - Scripting with Java](https://www.wearedevelopers.com/videos/2094-javascript-no-java-scripts-scripting-with-java) - [Playing Pong on a shoulder press machine](https://www.wearedevelopers.com/videos/100140-playing-pong-on-a-shoulder-press-machine) - [A Technical Introduction to Bitcoin's 2nd Layer- The Lightning Network](https://www.wearedevelopers.com/videos/15-a-technical-introduction-to-bitcoin-s-2nd-layer-the-lightning-network) - [Your Next AI Needs 10,000 GPUs. Now What?](https://www.wearedevelopers.com/videos/1590-your-next-ai-needs-10-000-gpus-now-what) ## Related Articles - [Best US AI Conferences for CTOs in 2026: Build vs. Buy, Vendor Evaluation, and Peer Intelligence](https://www.wearedevelopers.com/magazine/736-best-us-ai-conferences-for-ctos-in-2026-build-vs-buy-vendor-evaluation-and-peer-intelligence) - [Graph and AI Trends 2026: Why Is AI Running but Not Yet Delivering?](https://www.wearedevelopers.com/magazine/680-graph-and-ai-trends-2026-why-is-ai-running-but-not-yet-delivering) - [Stephan Gillich - Bringing AI Everywhere](https://www.wearedevelopers.com/magazine/489-stephan-gillich-bringing-ai-everywhere) - [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development) - [Everything a Developer Needs to Know About MCP with Neo4j](https://www.wearedevelopers.com/magazine/604-everything-a-developer-needs-to-know-about-mcp-with-neo4j) - [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud)