Infrastructure Engineer (Kubernetes, GPU/NVIDIA, Terraform)

ITcaps LLC
St. Louis, United States
5 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Job source

Tech stack

Artificial Intelligence Ubuntu (Operating System) Nvidia CUDA Linux DevOps Prometheus Azure Machine Learning Runbook AI Infrastructure Ceph (Software) Graphics Processing Unit (GPU) Cloud Platform System
+6 more
Grafana Software Troubleshooting Kubernetes Infrastructure Automation Frameworks Hardware Infrastructure Terraform

Job description

  • Design, deploy, and manage production-grade Kubernetes clusters
  • Build and maintain GPU-enabled infrastructure for AI/ML workloads
  • Deploy and manage Longhorn storage solutions
  • Automate infrastructure provisioning using Terraform
  • Monitor and optimize platform performance using Prometheus and Grafana
  • Troubleshoot Kubernetes, GPU, storage, and infrastructure issues
  • Collaborate with ML engineers, data scientists, and DevOps teams
  • Create technical documentation, runbooks, and operational guides
  • Conduct knowledge transfer (KT) sessions and hands-on workshops for client teams
  • Provide guidance on Kubernetes operations, NVIDIA GPU management, Longhorn storage, and Canonical ecosystem tools
  • Advise on cloud-native infrastructure, AI/ML platform best practices, scalability, reliability, and cost optimization
  • Ensure successful production handoff with full operational readiness

Requirements

We are seeking a highly skilled AI Infrastructure Engineer to design, build, and support scalable GPU-enabled Kubernetes platforms for AI/ML workloads. The ideal candidate will have strong expertise in Kubernetes, Linux, Terraform, and NVIDIA GPU technologies, with experience building enterprise-grade AI infrastructure., * Strong hands-on experience with Kubernetes

  • Expertise in Linux (Ubuntu)
  • Experience with Terraform (Infrastructure as Code)
  • Experience with GPUs and NVIDIA Stack (CUDA, NVIDIA GPU Operator, device plugins, scheduling)
  • Strong troubleshooting and automation skills

Preferred Skills

  • Experience with Longhorn or Ceph storage
  • Knowledge of Canonical ecosystem (MAAS, Juju, Charmed Kubernetes)
  • Experience with Kubeflow or other AI/ML platform tools
  • Certifications such as CKA or NVIDIA Certified, * Kubernetes
  • Linux (Ubuntu)
  • Terraform
  • NVIDIA GPU Stack
  • GPU Infrastructure
  • Prometheus
  • Grafana
  • AI Infrastructure
  • Infrastructure Automation, * Longhorn
  • Ceph
  • Kubeflow
  • MAAS
  • Juju
  • Charmed Kubernetes
  • CKA Certification
  • NVIDIA Certification

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

1:24 min

Comprehensive AI infrastructure stacks at the Linux Foundation

Matt White Matt White · WWC 2025

52 sec

Running persistent Linux environments directly on Windows

Ben Breard Ben Breard · WWC 2025

2:17 min

Mapping the maturity roadmap for scaled devops adoption

Dominik Krichbaum Dominik Krichbaum · WWC Europe 2026

10:40 min

Visualizing Prometheus open metrics using custom Grafana dashboards

Stijn Polfliet · LIVE

1:30 min

Overlooked AI infrastructure and operational deployment barriers

Stan Girard Stan Girard · WWC 2024

2:39 min

Experiencing core Linux capabilities for DevOps administration

Michael Cade · LIVE

Videos

See all

Related articles

See all