Senior Software Engineer - NVLink Rack Scale...

NVIDIA Ltd.
Santa Clara, CA, United States
3 months ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Compensation
$152,000.0 - $241,500.0
Working hours
Regular working hours
Job source

Tech stack

Artificial Intelligence C++ (Programming Language) Nvidia CUDA Computer Programming Computer Engineering Continuous Integration Data Centers Software Debugging Distributed Computing Environment Distributed Systems Ethernet Firmware
+17 more
InfiniBand Python (Programming Language) Networking Basics Routing PCI Express Remote Direct Memory Access Regression Testing Reliability Engineering Runbook Server Administration Verification and Validation (Software) Systems Architecture System Software System Testing TCP/IP AI Infrastructure Information Technology

Job description

We are looking for highly motivated Senior Software Engineers to join our Fabric Networking team with a targeted focus on NVLink Rack-Scale Systems Stability & Reliability. In this role, you will partner closely with architects and developers building our next-generation NVLink and NVSwitch systems, helping transform first-of-their-kind platforms into stable, reliable, and volume production-ready systems. You will work on complex system-level challenges spanning resiliency, diagnostics, recovery, and large-scale AI infrastructure, contributing directly to the software foundation powering next-generation datacenter deployments.

What you will be doing:

  • Drive platform bringup, feature enablement, end-to-end software validation, and debug for next-generation NVLink-based GPU and rack-scale systems.

  • Develop tools, diagnostics, automation, and infrastructure for system validation, regression testing, and fleet support.

  • Lead reliability and MTBI validation through stress testing, telemetry analysis, failure injection, and issue resolution.

  • Triage complex software, firmware, networking, and platform issues across validation, deployment, and production environments.

  • Collaborate with architecture, hardware, firmware, software, and Customer engagement teams to improve system quality and reliability.

  • Build and maintain SRE-style validation infrastructure, including provisioning, monitoring, and operational readiness.

  • Create automation, dashboards, runbooks, and debug workflows that improve root-cause analysis and operational efficiency.

Requirements

  • BS or MS in Computer Science, Computer Engineering, Electrical Engineering, or related field, or equivalent experience.

  • 5+ years of experience in system software, firmware, networking, platform enablement, data center infrastructure, or distributed systems.

  • Strong programming skills in C/C++ and Python; Bash/Shell scripting experience is a plus.

  • Strong system-level debugging across software, firmware, hardware, and networking layers.

  • Solid networking fundamentals, including TCP/IP, Ethernet and/or InfiniBand, RDMA/RoCE, routing, switching, and fabric performance analysis.

  • Experience with large-scale AI systems, including platform bringup, validation, reliability engineering, stress testing, telemetry analysis, and root-cause debugging.

  • Ability to triage complex multi-domain issues using logs, telemetry, experiments, and structured debugging methods.

  • Strong communication and collaboration skills across engineering, customer, and operations teams. Passion for building reliable next-generation AI infrastructure and solving complex system-level challenges at scale.

Ways to stand out from the crowd:

  • Experience with NVIDIA GPU systems, NVLink, NVSwitch, CUDA, and large-scale AI/HPC clusters such as NVIDIA GB200 NVL72.

  • Strong understanding of large-scale AI system architecture, including PCIe, memory hierarchy, DMA, high-speed interconnects, and distributed training/inference systems.

  • Experience with server management technologies, data center operations, cluster provisioning, scaling, and fleet monitoring.

  • Proven experience building diagnostics, automation, CI/CD pipelines, dashboards, and reliability tooling.

Benefits & conditions

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 152,000 USD - 241,500 USD for Level 3, and 184,000 USD - 287,500 USD for Level 4.

About the company

NVIDIA (Santa Clara, CA)

NVIDIA is leading the way in groundbreaking developments in Artificial Intelligence, High-Performance Computing and Visualization. The GPU, our invention, serves as the visual cortex of modern computers and is at the heart of our products and services. Our work opens up new universes to explore, enables amazing creativity and discovery, and powers what were once science fiction inventions from artificial intelligence to autonomous cars. NVIDIA is looking for phenomenal people like you to help us accelerate the next wave of artificial intelligence.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on juju.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:59 min

Scaling up and scaling out GPU clusters

Michael Kagan Michael Kagan +1 · WWC Europe 2026

2:50 min

Introduction and the value of runbooks

Hila Fish · WWC 2023

5:02 min

Mapping distributed compute paradigms to modern vehicles

Joachim Werner · LIVE

2:04 min

Enhancing network privacy with routing fees and onion routing

Andreas M Antonopoulos · LIVE

2:33 min

Architecting CUDA and the AI software stack

Michael Kagan Michael Kagan +1 · WWC Europe 2026

1:32 min

Structuring automated incident workflows between runbooks and raw models

Aram Hakobyan Aram Hakobyan +1 · WWC Europe 2026

Videos

See all

Related articles

See all