Principal AI Network Hardware Systems Engineer

Microsoft
Hillsboro, OR, United States
3 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
8 years minimum
Working hours
Regular working hours

Tech stack

Artificial Intelligence Systems Engineering Automation of Tests Microsoft Azure Data Link Communications Protocols Computer Engineering Network Congestion Software Debugging Distributed Computing Environment Network Interface Controllers Firmware
+12 more
Networking Hardware Interoperability Routing Network Service Remote Direct Memory Access System Software TCP/IP AI Infrastructure Diagnostic Tools Computer Networking Systems AI Platforms Low Latency

Job description

Experteer Overview In this role you lead the architecture and deployment of networking infrastructure for Microsoft’s MAIA AI platform, enabling high-performance AI training and inference at hyperscale. You will influence architectural direction across silicon, firmware, hardware, and Azure teams, delivering scalable networking solutions from concept to datacenter rollout. You will work on high-speed networking, AI fabric technologies, and distributed training workloads to improve latency, throughput, and reliability. This is a chance to shape next-generation AI networking for a global cloud leader with a strong culture of collaboration and growth. Compensation / Benefits * Define and develop networking requirements for large-scale AI training and inference clusters * Collaborate across silicon, system software, firmware, hardware, and Azure teams to deliver scalable networking solutions from concept through datacenter deployment * Participate in architecture reviews and influence next-generation AI networking roadmaps * Define concepts of operation, telemetry requirements, and operational models for AI infrastructure * Lead design and validation of IP-based AI networking solutions spanning TCP/IP, UDP, routing, QoS, and traffic engineering * Analyze transport-layer behavior and performance across large-scale distributed AI workloads * Evaluate network protocol implementations and debug issues impacting latency, throughput, scalability, and reliability * Drive optimization of network communication paths supporting distributed AI training and inference * Design, validate, and optimize RDMA-based networking solutions for AI clusters * Analyze RDMA performance, congestion behavior, packet loss, retransmissions, and collective communication efficiency * Work with networking vendors and software teams to optimize AI fabric performance and workload scalability * Develop validation methodologies for AI traffic patterns and collective communication workloads * Develop and execute networking validation strategies covering functionality, performance, scale, interoperability, resiliency, and reliability * Characterize network behavior under AI workloads * Evaluate latency, bandwidth utilization, congestion events, and workload communication patterns * Create and automate network stress, scale, and performance qualification methodologies * Lead end-to-end troubleshooting across physical, data link, network, and transport layers * Perform packet-level analysis and protocol debugging using telemetry and diagnostic tools * Investigate switch, NIC, RDMA, routing, congestion control, and protocol issues * Drive corrective actions and long-term reliability improvements using fleet telemetry and lab validation * Build and improve network observability, diagnostics, telemetry, and monitoring solutions * Develop tools for network validation, performance analysis, and failure detection * Improve engineering productivity through automated testing, qualification, and network health assessment frameworks Tasks * 8+ years of NW HW development * 8+ years of GPU based SU/SO development * 8+ years hands on experience with HS interface architecture and development * Master’s Degree in Electrical Engineering * or Bachelor’s Degree in Electrical Engineering, Computer Engineering, Mechanical Engineering, or related field with 8+ years of experience Key requirements *

Requirements

and networking validation strategies covering functionality, performance, scale, interoperability, resiliency, and reliability * Characterize network behavior under AI workloads * Evaluate latency, bandwidth utilization, congestion events, and workload communication patterns * Create and automate network stress, scale, and performance qualification methodologies * Lead end-to-end troubleshooting across physical, data link, network, and transport layers * Perform packet-level analysis and protocol debugging using telemetry and diagnostic tools * Investigate switch, NIC, RDMA, routing, congestion control, and protocol issues * Drive corrective actions and long-term reliability improvements using fleet telemetry and lab validation * Build and improve network observability, diagnostics, telemetry, and monitoring solutions * Develop tools for network validation, performance analysis, and failure detection * Improve engineering productivity through automated testing, qualification, and network a years assessment frameworks Tasks * 8+ years of NW HW development * 8+ years of GPU based SU/SO development * 8+ years hands on experience with HS interface architecture and development * Master’s Degree in Electrical Engineering * or Bachelor’s Degree in Electrical Engineering, Computer Engineering, Mechanical Engineering, or related field with 8+ years of experience Key requirements *

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on us.experteer.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:05 min

Acquiring Mellanox to build cohesive AI factories

Michael Kagan Michael Kagan +1 Ā· WWC Europe 2026

2:04 min

Enhancing network privacy with routing fees and onion routing

Andreas M Antonopoulos Ā· LIVE

5:02 min

Mapping distributed compute paradigms to modern vehicles

Joachim Werner Ā· LIVE

2:19 min

Orchestrating over-the-air firmware updates for vehicle modules

Denis Grahovac Ā· WWC 2021

3:20 min

Hard science and infrastructure enabled by artificial intelligence

Christian Nagel Christian Nagel +3 Ā· WWC Europe 2026

1:51 min

Overview of the three Google Maps routing applications

GermÔn Álvarez · LIVE

Videos

See all

Related articles

See all