> Markdown version of [/jobs/ext/4706597-principal-ai-system-architect](https://www.wearedevelopers.com/jobs/ext/4706597-principal-ai-system-architect). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Principal AI System Architect

- **Company:** Microsoft
- **Location:** Mountain View, CA, United States
- **Salary:** $165,600 - $296,400
- **Contract:** Permanent contract
- **Skills:** Artificial Intelligence, Microsoft Azure, Microsoft Online Services, Cloud Computing, Computer Engineering, Network Congestion, Data Centers, Hardware Design, Network Topologies, InfiniBand, Micro Systems Technologies, Microsoft Software, Systems Architecture, Xbox Linux, AI Platforms, Scalable Processor Architecture
- **Published:** November 13, 2026
- **Apply:** https://www.careerbuilder.com/job-details/principal-ai-system-architect-mountain-view-ca--988da9d2-b68f-44ae-bb08-72b2ead368e3

## About the Role

System Architecture, Artificial Intelligence (AI), Microsoft Product Family, Hardware Design, Cloud Computing, Business Strategy, Sun Microsystems SPARC Processor, Internet/Online Service, Microsoft Windows Azure, Xbox, We are seeking a passionate Principal AI System Architect to join the team. In this role you will own and define the system architecture requirements; it is a broad role with the ability to make a direct impact on Microsoft AI accelerator systems., * Masters Degree in Electrical Engineering, Computer Engineering, Mechanical Engineering, or related field AND 9+ years technical engineering experience OR Bachelors Degree in Electrical Engineering, Computer Engineering, Mechanical Engineering, or related field AND 11+ years technical engineering experience OR equivalent experience, * Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter., * Doctorate in Electrical Engineering, Computer Engineering, Mechanical Engineering, or related field AND 8+ years technical engineering experience OR Masters Degree in Electrical Engineering, Computer Engineering, Mechanical Engineering, or related field AND 12+ years technical engineering experience OR Bachelors Degree in Electrical Engineering, Computer Engineering, Mechanical Engineering, or related field AND 15+ years technical engineering experience OR equivalent experience

 * Experience in large scale AI datacenter systems and their network
 * Demonstrated expertise in one or more of these domains: networking (RoCE, Infiniband transports, congestion control, network topology design), reliability and serviceability, datacenter architecture for large scale AI systems
 * Experience owning hardware system architecture at scale - machine, rack row and cluster, authoring specifications and requirements
 * Ability to make decision trade-offs across domains
 * Deep expertise in AI systems or a key domain such as networking, reliability, power management
 * Skilled in partnering and influencing architects, hardware engineers, and software leads
 * Ability to manage through ambiguity, bringing clarity to establish direction and driving decisions
 * Collaboration skills, teamwork, and sense of presumed responsibility

Hardware Engineering IC6 - The typical base pay range for this role across the U.S. is USD $165,600 - $296,400 per year. There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $220,800 - $331,200 per year.

## Description

* Define AI rack- and cluster-scale architecture across accelerator, host, network, memory, storage, power, cooling, and datacenter constraints. Make quantitative tradeoffs across performance and TCO.
 * Develop functional proof-of-concepts to evaluate and de-risk new capabilities
 * Write and own high-level product requirements and specifications
 * Drive alignment across cross-functional engineering and leadership teams. Own the outcomes.
 * Use performance simulations and hardware models for what-if studies to evaluate and choose between architecture options.
 * Industry influence: Participate in industry consortiums to shape standards, and influence vendor roadmaps.