> Markdown version of [/jobs/ext/2921842-principal-ai-system-architect](https://www.wearedevelopers.com/jobs/ext/2921842-principal-ai-system-architect). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Principal AI System Architect - **Company:** Microsoft - **Location:** Redmond, WA, United States - **Experience:** Expert - **Salary:** $142,800.0 - $274,800.0 - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Microsoft Online Services, Computer Engineering, Network Congestion, Data Centers, Network Topologies, InfiniBand, Systems Architecture - **Published:** September 15, 2026 - **Apply:** https://www.jobmonkeyjobs.com/career/28019436/Principal-Ai-System-Architect-Washington-Redmond-1210 ## About the Role We are seeking a passionate Principal AI System Architect to join the team. In this role you will own and define the system architecture requirements; it is a broad role with the ability to make a direct impact on Microsoft AI accelerator systems., * Master's Degree in Electrical Engineering, Computer Engineering, Mechanical Engineering, or related field AND 7+ years technical engineering experience OR Bachelor's Degree in Electrical Engineering, Computer Engineering, Mechanical Engineering, or related field AND 8+ years technical engineering experience OR equivalent experience. Other Requirements * Abilityto meet Microsoft,customerand/or government security screening requirementsarerequiredfor this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will berequiredto pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter., * Doctorate in Electrical Engineering, Computer Engineering, Mechanical Engineering, or related field AND 5+ years of technical engineering experience OR Master's Degree in Electrical Engineering, Computer Engineering, Mechanical Engineering, or related field AND 8+ years technical engineering experience OR Bachelor's Degree in Electrical Engineering, Computer Engineering, Mechanical Engineering, or related field AND 12+ years technical engineering experience OR equivalent experience * Experience in large scale AI datacenter systems and their network * Demonstrated expertise in one or more of these domains: networking (RoCE, Infiniband transports, congestion control, network topology design), reliability and serviceability, datacenter architecture for large scale AI systems * Experience owning hardware system architecture at scale - machine, rack row and cluster, authoring specifications and requirements * Ability to make decision trade-offs across domains * Deep expertise in AI systems or a key domain such as networking, reliability, power management * Skilled in partnering and influencing architects, hardware engineers, and software leads * Ability to manage through ambiguity,bringingclarity to establish direction and driving decisions * Collaboration skills,teamwork,and senseof presumed responsibility Hardware Engineering IC5 - The typical base pay range for this role across the U.S. is USD $142,800 - $274,800 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $188,000 - $304,200 per year. ## Description * Define AI rack- and cluster-scale architecture across accelerator, host, network, memory, storage, power, cooling, and datacenter constraints. Make quantitative tradeoffs across performance and TCO. * Develop functional proof-of-concepts to evaluate and de-risk new capabilities * Write and own high-level product requirements and specifications * Drive alignment across cross-functional engineering and leadership teams. Own the outcomes. * Use performance simulations and hardware models for what-if studies to evaluate and choose between architecture options. * Industry influence: Participate in industry consortiums to shape standards, and influence vendor roadmaps. ## Related Videos - [The Gashlycrumb Tinies of AI Networking You Must Know (or Languish!)](https://www.wearedevelopers.com/videos/2067-the-gashlycrumb-tinies-of-ai-networking-you-must-know-or-languish) - [The Sustainability Race: AI's Promises, Pitfalls and Potential](https://www.wearedevelopers.com/videos/100155-the-sustainability-race-ai-s-promises-pitfalls-and-potential) - [Code meets connectivity - Developers as the powerhouse of Network API innovation](https://www.wearedevelopers.com/videos/1686-code-meets-connectivity-developers-as-the-powerhouse-of-network-api-innovation) - [Inside the AI Revolution: How Microsoft is Empowering the World to Achieve More](https://www.wearedevelopers.com/videos/869-inside-the-ai-revolution-how-microsoft-is-empowering-the-world-to-achieve-more) - [Building the Nervous System of AI - Michael Kagan (NVIDIA)](https://www.wearedevelopers.com/videos/2133-building-the-nervous-system-of-ai-michael-kagan-nvidia) - [HTTP 402: Teaching the Web to Let Agents Pay](https://www.wearedevelopers.com/videos/100232-http-402-teaching-the-web-to-let-agents-pay) ## Related Articles - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [What Industries Outside of AI Are Hiring The Most AI Experts?](https://www.wearedevelopers.com/magazine/98-what-industries-outside-of-ai-are-hiring-the-most-ai-experts) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Best Paying Jobs in Technology](https://www.wearedevelopers.com/magazine/256-best-paying-jobs-in-technology) - [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift) - [Top-Paying Tech Jobs (with Salaries)](https://www.wearedevelopers.com/magazine/372-top-paying-tech-jobs-with-salaries)