Senior Infrastructure Software Engineer, TensorRT Edge-LLM

NVIDIA Ltd.
Santa Clara, CA, United States
about 1 month ago
Apply on us.experteer.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
7 years minimum
Working hours
Regular working hours

Tech stack

Amazon Web Services Microsoft Azure C++ (Programming Language) CMake Continuous Integration DevOps Github Python (Programming Language) Perforce Software Vulnerability Management Google Cloud Large Language Models
+8 more
Gitlab Git Gitlab-ci Kubernetes Build Tools TensorRT Docker Jenkins

Job description

Experteer Overview In this role you will architect and maintain scalable infrastructure to support TensorRT Edge-LLM, enabling faster development, build, and test cycles across NVIDIA’s edge AI platforms. You’ll work with cross-functional teams to optimize CI/CD, tooling, and deployment across diverse environments, from autonomous vehicle to robotics hardware. You’ll shape the DevOps landscape for a rapidly growing compute software portfolio, driving reliability and security at scale. This is a hands-on opportunity to impact development velocity and platform resilience in edge AI. Compensation / Benefits * Build and maintain foundational infrastructure for TensorRT Edge-LLM * Maintain and optimize CI/CD pipelines to streamline build, test, and deployment * Configure and extend deployments of tools (CMake, GitLab, GitHub Actions, Kubernetes, Docker) * Develop across the software stack from UX to cluster layers * Monitor and tune CI/CD reliability on embedded and desktop CPU/GPU systems * Enable vulnerability management and CVE handling for infrastructure components Tasks * 7+ years of proven experience * Strong Python (or similar) and modern C/C++ development * Experience setting up, maintaining, and automating CI systems (Jenkins, GitHub Actions, GitLab CI) * Experience administering, monitoring, and deploying systems on GitHub and cloud platforms (AWS, GCP, Azure) * Fluency in SCM (Git, Perforce) and build systems (CMake, Make, Bazel) Key requirements * base salary * equity * benefits * hybrid work

Requirements

_ * Enable vulnerability management and CVE handling for infrastructure components Tasks * 7+ years of proven experience * Strong Python (or similar) and modern C/C++ development * Experience setting up, maintaining, and automating CI systems (Jenkins, GitHub Actions, GitLab CI) * Experience administering, monitoring, and deploying systems on GitHub and cloud platforms (AWS, GCP, Azure) * Fluency in SCM (Git, Perforce) and build systems (CMake, Make, Bazel) Key requirements * base salary * equity * benefits * hybrid work

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on us.experteer.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:07 min

Inspecting default bridge architectures and custom Docker networks

Oliver Seitz Oliver Seitz · World Congress 2025

1:15 min

Defining classes and building packages with pybind11

Konstantin Bespalov · World Congress 2023

6:21 min

Investigating push inefficiencies with upstream Git experts

Jonathan Creamer · Coffee With Developers

2:33 min

Architecting CUDA and the AI software stack

Michael Kagan Michael Kagan +1 · World Congress 2026 Europe

2:34 min

Docker sandbox architecture and microVM environment integration

Manuel de la Peña Manuel de la Peña · World Congress 2026 Europe

2:15 min

Open-source community and machine learning frameworks

Gian Marco Iodice Gian Marco Iodice · World Congress 2025

Videos

See all

Related articles

See all