Principal AI Network Hardware Systems Engineer

Microsoft
Redmond, WA, United States
4 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
8 years minimum
Working hours
Regular working hours

Tech stack

Artificial Intelligence Systems Engineering Automation of Tests Microsoft Azure Communications Protocols Software Debugging Firmware Networking Hardware Interoperability Microsoft Security Essentials Routing Remote Direct Memory Access
+8 more
System Software Systems Integration TCP/IP AI Infrastructure Iq/oq/pq Computer Networking Systems AI Platforms Low Latency

Job description

Experteer Overview In this role you will lead the architecture, bring-up, validation, optimization, and deployment of networking infrastructure for Microsoft’s MAIA AI platform. You will influence architectural direction and collaborate with silicon, firmware, hardware, software, and Azure teams to deliver scalable AI networking solutions at hyperscale. The position focuses on high-speed networking, AI fabric performance, and end-to-end system integration to enable next-generation AI workloads. This is a unique opportunity to shape AI networking for large-scale AI systems and infrastructure. Compensation / Benefits * Define networking requirements for large-scale AI training and inference clusters * Collaborate across silicon, system software, firmware, hardware, and Azure teams to deliver scalable networking solutions from concept to datacenter deployment * Participate in architecture reviews and influence AI networking roadmaps * Define concepts of operation, telemetry, serviceability, and operational models for AI infrastructure * Lead design and validation of IP-based AI networking (TCP/IP, UDP, routing, QoS) * Analyze transport-layer performance across distributed AI workloads * Evaluate and debug network protocol implementations impacting latency, throughput, and reliability * Drive optimization of network paths for distributed AI training and inference * Design, validate, and optimize RDMA-based networking for AI clusters * Develop validation methodologies for AI traffic patterns and workloads * Develop networking validation strategies for functionality, performance, scale, interoperability, resiliency * Characterize network behavior under AI workloads and automate stress and performance qualification * Lead end-to-end debugging across layers and implement corrective actions using fleet telemetry * Build and improve network observability, telemetry, and monitoring tooling * Improve engineering productivity through automated testing and network health assessment frameworks Tasks * 8+ years of NW HW development experience * 8+ years of GPU-based SU/SO development experience * 8+ years of hands-on HS interface architecture and development * Master’s or Bachelor’s degree in relevant field or equivalent experience * Ability to meet Microsoft security screening requirements Key requirements *

Requirements

US and operational models for AI infrastructure * Lead design and validation of IP-based AI networking (TCP/IP, UDP, routing, QoS) * Analyze transport-layer performance across distributed AI workloads * Evaluate and debug network protocol implementations impacting latency, throughput, and reliability * Drive optimization of network paths for distributed AI training and inference * Design, validate, and optimize RDMA-based networking for AI clusters * Develop validation methodologies for AI traffic patterns and workloads * Develop networking validation strategies for functionality, performance, scale, interoperability, resiliency * Characterize network behavior under AI workloads and automate stress and performance qualification * Lead end-to-end debugging across layers and implement corrective actions using fleet telemetry * Build and improve network observability, telemetry, and monitoring tooling * Improve engineering productivity through automated testing and network health assessment frameworks Tasks * 8+ years of NW HW development experience * 8+ years of GPU-based SU/SO development experience * 8+ years of hands-on HS interface architecture and development * Master’s or Bachelor’s degree in relevant field or equivalent experience * Ability to meet Microsoft security screening requirements Key requirements *

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on us.experteer.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

5:02 min

Mapping distributed compute paradigms to modern vehicles

Joachim Werner Ā· LIVE

2:04 min

Enhancing network privacy with routing fees and onion routing

Andreas M Antonopoulos Ā· LIVE

3:05 min

Acquiring Mellanox to build cohesive AI factories

Michael Kagan Michael Kagan +1 Ā· WWC Europe 2026

3:50 min

Queues in TCP stacks and continuous network connections

Clemens Vasters Clemens Vasters Ā· WWC 2022

2:42 min

Dissecting artificial intelligence layers from compute to applications

Christian Nagel Christian Nagel +3 Ā· WWC Europe 2026

1:51 min

Overview of the three Google Maps routing applications

GermÔn Álvarez · LIVE

Videos

See all

Related articles

See all