Systems Engineer / Site Reliability Engineer (SRE)

SS Business Services LLC

San Jose, CA, United States

2 days ago

Apply on www.juju.com

Prepare application

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Working hours

Regular working hours

Job source

www.juju.com

Tech stack

Systems Engineering Cloud Computing Nvidia CUDA Linux Distributed Systems InfiniBand Python (Programming Language) Performance Tuning Reliability Engineering System Availability Kubernetes Hardware Infrastructure

+1 more

Model Inference

Job description

Seeking a Systems Engineer / SRE to design, automate, and maintain large-scale AI inference infrastructure. The role focuses on GPU cluster reliability, bare-metal provisioning, Kubernetes orchestration, Linux performance optimization, and infrastructure automation. Responsible for ensuring high availability, scalability, and performance across distributed accelerator environments., * Design and maintain scalable GPU infrastructure for AI inference workloads.

Automate bare-metal provisioning and server lifecycle management.
Manage Kubernetes clusters and optimize Linux/GPU performance.
Troubleshoot GPU, network, and distributed system bottlenecks.
Implement monitoring, telemetry, and automated recovery solutions.
Conduct root-cause analysis and improve infrastructure reliability.

Requirements

Experience in hyperscale environments, distributed systems, or GPU cloud infrastructure.
NVIDIA GPU drivers, CUDA, Fabric Managers, NCCL.
Kubernetes cluster management at scale.
Programming: Python or Go.
GPU networking: RoCEv2, InfiniBand.
SLIs/SLOs, telemetry, automated self-healing, root-cause analysis.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.juju.com

Prepare application

Good distractions

Loading talks and stories from around this role…