> Markdown version of [/jobs/ext/4604073-solutions-architect-with-gpu-infrastructure](https://www.wearedevelopers.com/jobs/ext/4604073-solutions-architect-with-gpu-infrastructure). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Solutions Architect with GPU infrastructure

- **Company:** Astir IT Solutions, Inc.
- **Location:** South Plainfield, NJ, United States (Remote available)
- **Contract:** Permanent contract
- **Skills:** Application Programming Interfaces (APIs), Artificial Intelligence, Bash Shell, Computer Clusters, Nvidia CUDA, Data Centers, File Systems, InfiniBand, Python (Programming Language), Linux System Administration, Node.Js, OpenStack, Ansible, Prometheus, Weka, AI Infrastructure, Retrieval-Augmented Generation, Large Language Models, Grafana, Qwen, Caching, Perf (Linux), Kubernetes, Bare Metal, SGLang, ROCm, TensorRT, Hardware Infrastructure, Nim (Programming Language), Software Coding, VLLM, Model Inference, Terraform, Deepseek (AI Talent Sourcing Platform), KServe
- **Published:** November 6, 2026
- **Apply:** https://www.juju.com/job/2_173708166

## About the Role

· 15+ years in enterprise infrastructure, cloud or solution architecture, including customer-facing pre-sales or consulting roles.

· GPU infrastructure (mandatory): 5+ years hands-on designing, deploying or operating GPU clusters.

· GPU selling: 1+ years selling GPU capacity, GPU cloud or AI infrastructure, with technical wins on multi-year GPU commitments.

· AI data center: Understanding of AI data center nuances (high-density power, liquid cooling, power availability and lead times, facility readiness) and how they constrain GPU design, cost and timelines.

· Scaling AI workloads: Experience scaling production AI workloads from single node to multi-node and multi-cluster, including autoscaling, multi-tenant GPU sharing and capacity planning.

· LLM inference: 2+ years deploying and operating LLM inference in production (such as vLLM, SGLang, TensorRT-LLM or NIM).

· Hands-on coding: Strong, current hands-on coding in Python, plus Bash and Infrastructure as Code (Terraform, Ansible, Helm). Personally builds POCs, benchmark harnesses, sizing tools and inference deployments, not only designs them.

· Hands-on technical skills: Personally deploys and troubleshoots GPU environments: Linux administration, GPU drivers and CUDA/ROCm, containers, Kubernetes (GPU Operator, Helm), standing up and tuning serving engines (vLLM, SGLang), running benchmarks (GenAI-Perf, NCCL tests) and monitoring (DCGM, Prometheus, Grafana).

· Technical Expertise

· GPU infrastructure

· Accelerators and their sizing characteristics (HBM, memory bandwidth, scale-up domain, power): NVIDIA H100/H200, B200/B300, GB200/GB300 NVL72; AMD Instinct MI300X/MI325X/MI355X; roadmap awareness (Vera Rubin, MI400).

· Networking and storage: NVLink/NVSwitch, InfiniBand and RoCEv2/Spectrum-X, SuperNICs/DPUs; parallel and all-flash file systems (WEKA, VAST, DDN) and GPUDirect Storage.

· Orchestration and multi-tenancy: Kubernetes with NVIDIA GPU Operator and AMD ROCm equivalents, MIG, time-slicing, bare-metal provisioning on OpenStack, tenant isolation and quotas.

## Description

· Serving engines: vLLM, SGLang, TensorRT-LLM, Triton and NIM, AMD ROCm stack; KServe and Gateway API Inference Extension; disaggregated serving (NVIDIA Dynamo, llm-d).

· Optimization: continuous batching, KV-cache management, prefix caching, speculative decoding and quantization (FP8, FP4, INT4).

· Sizing and benchmarking: GPU count, type and parallelism (tensor, pipeline, expert) to model, context length, traffic and SLA; TTFT, inter-token latency, goodput and cost per million tokens. xrbllit

Hit Apply below to send your application for consideration Ensure that your CV is up to date, and that you have read the job specs first.

· Open-weight models (Llama, Qwen, DeepSeek, Mistral, gpt-oss), including MoE and long-context models, plus RAG, agentic and model-gateway patterns.