> Markdown version of [/jobs/ext/3584447-production-engineer-dgx-cloud](https://www.wearedevelopers.com/jobs/ext/3584447-production-engineer-dgx-cloud). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Production Engineer - DGX Cloud - **Company:** NVIDIA Ltd. - **Location:** Santa Clara, United States (Remote available) - **Experience:** Expert - **Salary:** $184,000.0 - $287,500.0 - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Amazon Web Services, Microsoft Azure, Cloud Computing, Configuration Management, Nvidia CUDA, Computer Programming, Continuous Integration, Software Debugging, Linux, Distributed Systems, Python (Programming Language), Networking Basics, Octopus Deploy, Software Engineering, Google Cloud, Cloud Platform System, Pytorch, Large Language Models, AI Platforms, Kubernetes, Information Technology, SGLang, TensorRT, Hardware Infrastructure, VLLM, Model Inference, Terraform - **Published:** October 4, 2026 - **Apply:** https://startup.jobs/senior-production-engineer-dgx-cloud-2100-nvidia-usa-10275377 ## About the Role * 8+ years of experience building or operating production services and large-scale distributed systems, including hands-on automation. * Strong programming skills in Python, Go, or a comparable language, with experience developing tools for production operations. * Experience with infrastructure as code, configuration management, or GitOps, and with building automation for repeatable service deployments and changes. * Strong knowledge of Linux, Kubernetes, containers, cloud infrastructure, distributed systems, and networking fundamentals; ability to diagnose failures in production. * Understanding of SRE principles, including SLIs, SLOs, error budgets, incident response, and reducing operational toil. * Experience instrumenting services and using metrics, logs, and traces to understand system behavior and improve reliability. * Clear technical communication and ability to work across engineering teams. * BS/MS in Computer Science or equivalent experience. Ways to stand out from the crowd * Familiarity with technologies such as vLLM, SGLang, PyTorch, TensorRT-LLM, NVIDIA Dynamo, CUDA, or NCCL, and with GPU performance analysis. * Experience building Kubernetes operators, controllers, workload orchestration services, fleet management systems, or self-healing automation. * Experience with Terraform, Argo CD, CI/CD, policy validation, or safe deployment and rollback systems. * Experience developing with AI tools and agents. * Background with production AI inference or agentic workloads, including debugging issues across models, runtimes, Kubernetes, and hardware. ## Description NVIDIA DGX Cloud delivers AI services and endpoints for research and production workloads. We are looking for a Senior Production Engineer to build software and automation that make those services reliable, scalable, and safe to operate. The Production Engineering team works on large-scale distributed systems spanning internal and external model endpoints; regional control plane services that orchestrate workloads and route requests; and the GPU/CPU compute infrastructure where inference and agentic workloads run. Our work spans Kubernetes clusters across AWS, Azure, Google Cloud, other partner cloud environments, and on-premises deployments. What you'll be doing: * Build and operate production software, automation, and tooling for control plane services, model deployments, and inference and agentic workloads across DGX Cloud environments. * Improve the reliability of inference and agentic platforms and services, including NVIDIA Cloud Functions, SGLang- and vLLM-based endpoints, and inference services built with NVIDIA Dynamo, through health validation, safer rollouts, observability, and recovery. * Improve endpoint availability, inference routing, capacity management, and service health to maintain predictable performance as workloads and demand change. * Use infrastructure as code and GitOps to deploy, configure, validate, upgrade, and recover services consistently across environments. * Build workflows for service enablement, model releases, handoff, deprecation, and ongoing operations; replace repeatable manual work with reliable automation. * Define and instrument SLIs and SLOs for inference and control plane services, including availability and latency, use error budgets to guide reliability improvements, and make production health visible to partner teams. * Participate in on-call and incident response, troubleshoot failures across routing, model runtimes, software, and infrastructure, and turn recurring issues into automation and durable fixes. * Collaborate with model, platform, storage, networking, security, and GPU infrastructure teams to design and operate services safely at scale. ## Related Videos - [Tour de Force: Open-Source LLM Inference Optimization from Simple to Sophisticated](https://www.wearedevelopers.com/videos/100099-tour-de-force-open-source-llm-inference-optimization-from-simple-to-sophisticated) - [Your Next AI Needs 10,000 GPUs. Now What?](https://www.wearedevelopers.com/videos/1590-your-next-ai-needs-10-000-gpus-now-what) - [Docker network without Docker](https://www.wearedevelopers.com/videos/1418-docker-network-without-docker) - [Efficient deployment and inference of GPU-accelerated LLMs​](https://www.wearedevelopers.com/videos/929-efficient-deployment-and-inference-of-gpu-accelerated-llms) - [Localized Open Models in Production: What Builders Need to Know](https://www.wearedevelopers.com/videos/100270-localized-open-models-in-production-what-builders-need-to-know) - [Docker exec without Docker](https://www.wearedevelopers.com/videos/1094-docker-exec-without-docker) ## Related Articles - [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud) - [7 Cloud Computing Trends Coming in 2025 for Developers](https://www.wearedevelopers.com/magazine/412-7-cloud-computing-trends-coming-in-2025-for-developers) - [Best US AI Conferences for CTOs in 2026: Build vs. Buy, Vendor Evaluation, and Peer Intelligence](https://www.wearedevelopers.com/magazine/736-best-us-ai-conferences-for-ctos-in-2026-build-vs-buy-vendor-evaluation-and-peer-intelligence) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [From Prototype to Production: Build AI Agents with This Free 4-Course Learning Path](https://www.wearedevelopers.com/magazine/655-from-prototype-to-production-build-ai-agents-with-this-free-4-course-learning-path)