Principal Network Engineer

TensorWave Inc.
Las Vegas, NV, United States
4 days ago
Apply on www.careerbuilder.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours

Tech stack

Artificial Intelligence Application Layers Cloud Computing Computer Networks Ethernet Python (Programming Language) Network Architecture Routing Performance Tuning Remote Direct Memory Access Ansible Alwayson
+8 more
Graphics Processing Unit (GPU) Computer Network Operations High Performance Computing Juniper Git Data Center Networking Information Technology Terraform

Job description

We’re seeking a Principal Network Engineer (L7) focused on owning and evolving large-scale, RoCEv2 data center networks powering next generation AI and ML infrastructure. You’ll work closely with our network architect and infrastructure leadership to define how the network is designed, implemented, and operated at scale, keeping over 8,000 GPUs burring today and scaling to cluster sizes reaching over 100,000 GPUs. You will be responsible for the architectural decisions that determine performance, reliability, and operational sanity at scale.

You’ll remain hands-on with high-speed optics, switching, routing, and congestion management in production clusters, while also setting the standards, patterns, and tooling other engineers build and operate against.

What You’ll Do

  • As a Principal Engineer, you own end-to-end network architecture, make high-impact design decisions, and set technical direction across teams, with clear examples of systems you’ve defined and scaled
  • Define, evolve, and standardize large-scale RoCEv2 data center networks supporting AI and ML clusters from thousands to 100,000+ GPUs
  • Set and validate congestion management strategy across RDMA fabrics, including PFC, ECN, and DCQCN, based on real production behavior
  • Establish automation, validation, and observability patterns that prevent misconfiguration and eliminate manual operational work
  • Act as the technical escalation point for complex failures, scaling limits, and architectural tradeoffs in always-on, multi-tenant environments

Requirements

Network Architecture/Engineering, Artificial Intelligence (AI), Cloud Computing, Network Operations Center, Network Architecture/Engineering, Computer Networks, Layer 7 Protocols, Architectural Services, Leadership, GPU (Graphics Processing Unit), * Bachelor’s degree in Computer Science, Electrical Engineering, or a related technical field, or equivalent practical experience

  • Deep experience designing and operating RDMA and RoCEv2 networks in large-scale production environments supporting AI or HPC workloads
  • Expert-level knowledge of switching hardware and their NOS, such as Arista, Juniper, and custom solutions using SONiC, including high-speed Ethernet fabrics
  • Proven hands-on experience with congestion management and performance tuning using PFC, ECN, and DCQCN
  • Strong experience with high-speed optics and cabling including 400G, 800G, and AEC, AOC, DAC, and structured cabling at scale
  • Strong automation mindset, with experience using Python, Ansible, Terraform, Git, and production observability tooling
  • We’re looking for engineers who operate comfortably at scale, make hard calls with incomplete data, and take responsibility for systems that must work under sustained load. The solutions that work on a handful of devices will not work at Exascale.

Benefits & conditions

  • 100% paid Medical, Dental, and Vision insurance for Employees

  • Company Health Savings Account Contributions

  • 100% paid Short Term and Long Term Disability Insurance for Employees

  • Life and Voluntary Supplemental Insurance Options

  • Other Insurance Options, such as Pet & Legal Insurance

  • Various Supplementary Health Benefits, such as discounted Virtual Healthcare Appointments and Serious Illness Support

  • Flexible Spending Account

  • 401(k)

  • Employee Assistance Program

  • Flexible PTO

  • Paid Holidays

  • Parental Leave

  • Other In-Office Perks

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerbuilder.com
Prepare application

Good distractions

Loading talks and stories from around this role…