Infrastructure Engineer (Kubernetes, GPU/NVIDIA, Terraform)
ITcaps LLC
St. Louis, United States
5 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Job source
Tech stack
Artificial Intelligence
Ubuntu (Operating System)
Nvidia CUDA
Linux
DevOps
Prometheus
Azure Machine Learning
Runbook
AI Infrastructure
Ceph (Software)
Graphics Processing Unit (GPU)
Cloud Platform System
+6 more
Grafana
Software Troubleshooting
Kubernetes
Infrastructure Automation Frameworks
Hardware Infrastructure
Terraform
Job description
- Design, deploy, and manage production-grade Kubernetes clusters
- Build and maintain GPU-enabled infrastructure for AI/ML workloads
- Deploy and manage Longhorn storage solutions
- Automate infrastructure provisioning using Terraform
- Monitor and optimize platform performance using Prometheus and Grafana
- Troubleshoot Kubernetes, GPU, storage, and infrastructure issues
- Collaborate with ML engineers, data scientists, and DevOps teams
- Create technical documentation, runbooks, and operational guides
- Conduct knowledge transfer (KT) sessions and hands-on workshops for client teams
- Provide guidance on Kubernetes operations, NVIDIA GPU management, Longhorn storage, and Canonical ecosystem tools
- Advise on cloud-native infrastructure, AI/ML platform best practices, scalability, reliability, and cost optimization
- Ensure successful production handoff with full operational readiness
Requirements
We are seeking a highly skilled AI Infrastructure Engineer to design, build, and support scalable GPU-enabled Kubernetes platforms for AI/ML workloads. The ideal candidate will have strong expertise in Kubernetes, Linux, Terraform, and NVIDIA GPU technologies, with experience building enterprise-grade AI infrastructure., * Strong hands-on experience with Kubernetes
- Expertise in Linux (Ubuntu)
- Experience with Terraform (Infrastructure as Code)
- Experience with GPUs and NVIDIA Stack (CUDA, NVIDIA GPU Operator, device plugins, scheduling)
- Strong troubleshooting and automation skills
Preferred Skills
- Experience with Longhorn or Ceph storage
- Knowledge of Canonical ecosystem (MAAS, Juju, Charmed Kubernetes)
- Experience with Kubeflow or other AI/ML platform tools
- Certifications such as CKA or NVIDIA Certified, * Kubernetes
- Linux (Ubuntu)
- Terraform
- NVIDIA GPU Stack
- GPU Infrastructure
- Prometheus
- Grafana
- AI Infrastructure
- Infrastructure Automation, * Longhorn
- Ceph
- Kubeflow
- MAAS
- Juju
- Charmed Kubernetes
- CKA Certification
- NVIDIA Certification
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.dice.comGood distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
CS
Christina Schaireiter
2 months ago
LM
Luis Minvielle
7 Cloud Computing Trends Coming in 2025 for Developers
over 2 years ago
EM
Eli McGarvie
Highest Paying Tech Companies for Developers
over 3 years ago
Learning Kubernetes made easy with KubeCampus
over 2 years ago
ER
Erin Rifkin
Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud
about 1 year ago
LM
Luis Minvielle
How to Become an AI Engineer
over 2 years ago