Senior/Staff SRE for AI/ML Platform Infrastructure

Xoriant Corporation

San Jose, CA, United States

27 days ago

Apply on www.dice.com

Prepare application

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Experience level

Expert

Working hours

Regular working hours

Job source

www.dice.com

Tech stack

Artificial Intelligence Amazon Web Services Microsoft Azure Bash Shell Nvidia CUDA Continuous Integration Distributed Computing Environment Distributed Systems Domain Name System (DNS) Github InfiniBand Python (Programming Language)

+17 more

Networking Basics Remote Direct Memory Access Prometheus Data Logging Google Cloud Load Balancing Cloud Platform System Grafana Firewalls (Computer Science) Gitlab-ci Kubernetes Machine Learning Operations Hardware Infrastructure Terraform Dynatrace Docker Jenkins

Requirements

Production on-call experience in a real rotation, with incident command and blameless postmortem practice.
Production Kubernetes and container experience (Docker), with cloud-native infrastructure patterns.
Hands-on production ownership on at least one major cloud (AWS, Google Cloud Platform, or Azure).
Terraform or OpenTofu proficiency.
Observability depth with Prometheus, Grafana, or equivalent for metrics, logging, and alerting, including dashboard and alert design.
Strong automation skills in Python, Bash, or Go.
Networking fundamentals: VPCs, load balancers, DNS, firewalls, cross-cloud connectivity.
CI/CD experience with GitHub Actions, GitLab CI, Jenkins, or ArgoCD.
Proven ability to troubleshoot complex distributed systems, largely self-directed.

Preferred Qualifications

GPU infrastructure and AI/ML workloads: Ray, Kubeflow, MLflow, or similar.
NVIDIA GPU orchestration: A100/H100 configuration, driver and CUDA runtime management.
Distributed training networking: RDMA, InfiniBand, EFA, NCCL.
Distributed tracing and OpenTelemetry instrumentation across services.