Kubernetes Platform Engineer
Role details
Job location
Tech stack
Job description
This role has been designed as 'Hybrid' with an expectation that you will work on average 2 days per week from an HPE office., We are seeking a Kubernetes Platform Engineer (High-Performance Networking) to lead Kubernetes-native, RDMA-class networking for distributed AI inference platforms on HPC clusters. You will own the end-to-end technical design that allows Kubernetes-orchestrated inference workloads (NVIDIA NIMs, vLLM, TensorRT-LLM) to transparently consume high-speed fabrics (e.g., HPE Slingshot/CXI) using Operators, DRA, CDI, Multus/secondary CNI, and Kubernetes networking abstractions-without container rebuilds, privileged pods, or manual tuning. This role is central to transforming a traditionally HPC-centric fabric into a first-class Kubernetes resource, aligned with modern AI Factory and inference-as-a-service deployment models.
Make HPC fabric capabilities consumable from standard containers Design the mechanisms to expose RDMA-capable NIC resources and required runtime components without baking the fabric into images, including mounting/injecting host user-space libraries (e.g., libcxi + libfabric) in a controlled, supportable way.
- Define the reference design and implement for Kubernetes-native RDMA enablement across:
- Dynamic Resource Allocation (DRA)
- Container Device Interface (CDI)
- Multus + secondary CNIs
- Operator-driven lifecycle management
- Own API and CRD design (ResourceClaims, DeviceClasses, custom CRDs) with long-term compatibility guarantees.
- Make and defend architectural tradeoffs between:
- Device plugins vs DRA
- CDI vs runtime hooks vs admission webhooks
- Shared vs exclusive NIC models
- Performance vs operability vs isolation
- Kubernetes Operator Ownership
- Define how distributed inference patterns (KV-cache movement, prefill/decode separation) map onto Kubernetes primitives.
- Ensure out-of-the-box compatibility with:
- NVIDIA NIMs and the NIM Operator
- KServe ServingRuntime / InferenceService
- GPU Operator (CDI mode)
- Publish deployment patterns and validated manifests for inference workloads using RDMA fast paths.
Requirements
Cloud Architectures, Cross Domain Knowledge, Design Thinking, Development Fundamentals, DevOps, Distributed Computing, Microservices Fluency, Full Stack Development, Security-First Mindset, Solutions Design, Testing & Automation, User Experience (UX)
Benefits & conditions
"The expected salary/wage range for this position is provided below. Actual offer may vary from this range based upon geographic location, work experience, education/training, and/or skill level.
- United States of America: Annual Salary USD 111,500 - 211,500 in Colorado // 106,000 - 243,000 in Minnesota & Texas The listed salary range reflects base salary. Variable incentives may also be offered."