Senior Software Engineer, Fleet Intelligence Agent Systems

NVIDIA Corporation
Santa Clara, CA, United States
2 days ago
Apply on nvidia.wd5.myworkdayjobs.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Compensation
$152,000.0 - $241,500.0
Working hours
Regular working hours

Tech stack

Application Programming Interfaces (APIs) Artificial Intelligence Cloud Computing Code Review Nvidia CUDA Computer Engineering Daemon Tools Data Centers Software Debugging Linux File Systems Firmware
+18 more
Issue Tracking Systems InfiniBand Online Transaction Processing Open Source Technology PCI Express Reliability Engineering Prometheus Software Deployment Software Engineering Graphics Processing Unit (GPU) Backend Rate Limiting Kubernetes Information Technology Bare Metal Free and Open-Source Software Hardware Infrastructure Docker

Job description

Today, we’re tapping into the unlimited potential of AI to define the next era of computing. An era in which our GPUs act as the brains of computers, robots, and self-driving cars that can understand the world. Doing what’s never been done before takes vision, innovation, and the world’s best talent., As an NVIDIAN, you’ll be immersed in a diverse, supportive environment where everyone is encouraged to do their best work. NVIDIA is widely recognized as one of the most desirable employers, with some of the most versatile people in the world working for us. If you’re passionate about building reliable systems software for cloud-scale GPU infrastructure, we encourage you to contribute to our team. We are looking for a Senior Software Engineer to join our DGX Cloud / Fleet Intelligence team and build agent-side systems that collect GPU health, host telemetry, inventory, attestation evidence, and BMC data across NVIDIA’s GPU fleet. This role includes contributing to open source software used by developers, operators, and customers working with NVIDIA GPU infrastructure.

What You’ll Be Doing:

This role focuses on Fleet Intelligence in-band agent and out-of-band collector systems used for GPU health monitoring, host and BMC telemetry, inventory, attestation, diagnostics, and cloud operations automation, you will:

  • Design and develop Fleet Intelligence agent software that runs on Linux hosts, bare metal systems, and Kubernetes GPU nodes.
  • Build telemetry and health collection for NVIDIA GPUs, DCGM/NVML, drivers, CUDA runtime, InfiniBand, containers, kernel/OS state, CPU, memory, disk, and networking.
  • Develop inventory, enrollment, node identity, local state, attestation, and backend export workflows and maintain local API, Prometheus metrics, file export, and OTLP/HTTP export paths.
  • Build and improve Kubernetes daemonset deployment, systemd service packaging, .deb/.rpm packaging, and container image workflows.
  • Contribute to open source Fleet Intelligence agent and collector software, including code, tests, documentation, release artifacts, and community-facing engineering practices.
  • Contribute to out-of-band collection using Redfish/BMC interfaces for inventory, GPU attestation, BMC metrics, and logs.
  • Improve collector concurrency, rate limiting, retry behavior, credential handling, partial-failure handling, and backend submission semantics.
  • Collaborate with backend, infrastructure, SRE, security, and datacenter operations teams to deliver reliable GPU fleet observability.

Requirements

  • 5+ years of industry software engineering experience with a Bachelor’s or Master’s degree in Computer Science, Computer Engineering, Electrical Engineering, or equivalent experience.
  • Strong Go development experience for Linux services, CLIs, agents, or daemons.
  • Rust experience, or strong willingness to work in Rust, for out-of-band collector development.
  • Strong Linux systems knowledge, including processes, filesystems, networking, service lifecycle, logs, permissions, and host diagnostics.
  • Experience with telemetry, observability, health monitoring, or fleet-management systems and with Docker, Kubernetes, Helm, and production deployment workflows.
  • Experience contributing to open source projects or working in public repositories with code review, issue tracking, documentation, release notes, and signed commits.
  • Familiarity with secure credential handling, enrollment flows, tokens/JWTs, and service-to-service authentication.
  • Strong debugging skills across hardware-adjacent software, operating systems, containers, and distributed backend integrations.

Ways To Stand Out From The Crowd:

  • Background with NVIDIA datacenter GPUs, DGX systems, DCGM, NVML, CUDA, GPU drivers, XID/SXID events, or GPU diagnostics.
  • Experience building host agents, node agents, collectors, monitoring daemons, or Kubernetes daemonsets.
  • Background with Redfish, BMCs, firmware inventory, secure boot state, PCIe device inventory, or hardware attestation.
  • Experience with OpenTelemetry, Prometheus, OTLP gateways, or metric/log export pipelines and operating software in AI, HPC, cloud, or large-scale datacenter environments.
  • Track record of meaningful open source contributions in systems software, observability, Kubernetes, Linux, hardware telemetry, Rust, or Go ecosystems.

Benefits & conditions

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 152,000 USD - 241,500 USD for Level 3, and 184,000 USD - 287,500 USD for Level 4.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on nvidia.wd5.myworkdayjobs.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:33 min

Architecting CUDA and the AI software stack

Michael Kagan Michael Kagan +1 · World Congress 2026 Europe

52 sec

Running persistent Linux environments directly on Windows

Ben Breard Ben Breard · World Congress 2025

2:07 min

Inspecting default bridge architectures and custom Docker networks

Oliver Seitz Oliver Seitz · World Congress 2025

1:52 min

Structuring and scaling the backend engineering team

Stefan Lingler Stefan Lingler +1 · Coffee With Developers

48 sec

Transitioning from scaling GPU workloads to building coding agents

Alex Laubscher Alex Laubscher · World Congress 2025

3:55 min

Demonstrating .NET installation on Debian and Azure Linux

Silvano Coriani Silvano Coriani · Europe 2026 Virtual

Videos

See all

Related articles

See all