Principal Network Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+8 more
Job description
We’re seeking a Principal Network Engineer (L7) focused on owning and evolving large-scale, RoCEv2 data center networks powering next generation AI and ML infrastructure. You’ll work closely with our network architect and infrastructure leadership to define how the network is designed, implemented, and operated at scale, keeping over 8,000 GPUs burring today and scaling to cluster sizes reaching over 100,000 GPUs. You will be responsible for the architectural decisions that determine performance, reliability, and operational sanity at scale.
You’ll remain hands-on with high-speed optics, switching, routing, and congestion management in production clusters, while also setting the standards, patterns, and tooling other engineers build and operate against.
What You’ll Do
- As a Principal Engineer, you own end-to-end network architecture, make high-impact design decisions, and set technical direction across teams, with clear examples of systems you’ve defined and scaled
- Define, evolve, and standardize large-scale RoCEv2 data center networks supporting AI and ML clusters from thousands to 100,000+ GPUs
- Set and validate congestion management strategy across RDMA fabrics, including PFC, ECN, and DCQCN, based on real production behavior
- Establish automation, validation, and observability patterns that prevent misconfiguration and eliminate manual operational work
- Act as the technical escalation point for complex failures, scaling limits, and architectural tradeoffs in always-on, multi-tenant environments
Requirements
Network Architecture/Engineering, Artificial Intelligence (AI), Cloud Computing, Network Operations Center, Network Architecture/Engineering, Computer Networks, Layer 7 Protocols, Architectural Services, Leadership, GPU (Graphics Processing Unit), * Bachelor’s degree in Computer Science, Electrical Engineering, or a related technical field, or equivalent practical experience
- Deep experience designing and operating RDMA and RoCEv2 networks in large-scale production environments supporting AI or HPC workloads
- Expert-level knowledge of switching hardware and their NOS, such as Arista, Juniper, and custom solutions using SONiC, including high-speed Ethernet fabrics
- Proven hands-on experience with congestion management and performance tuning using PFC, ECN, and DCQCN
- Strong experience with high-speed optics and cabling including 400G, 800G, and AEC, AOC, DAC, and structured cabling at scale
- Strong automation mindset, with experience using Python, Ansible, Terraform, Git, and production observability tooling
- We’re looking for engineers who operate comfortably at scale, make hard calls with incomplete data, and take responsibility for systems that must work under sustained load. The solutions that work on a handful of devices will not work at Exascale.
Benefits & conditions
-
100% paid Medical, Dental, and Vision insurance for Employees
-
Company Health Savings Account Contributions
-
100% paid Short Term and Long Term Disability Insurance for Employees
-
Life and Voluntary Supplemental Insurance Options
-
Other Insurance Options, such as Pet & Legal Insurance
-
Various Supplementary Health Benefits, such as discounted Virtual Healthcare Appointments and Serious Illness Support
-
Flexible Spending Account
-
401(k)
-
Employee Assistance Program
-
Flexible PTO
-
Paid Holidays
-
Parental Leave
-
Other In-Office Perks
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this role…