> Markdown version of [/jobs/ext/3937054-ai-site-reliability-engineer](https://www.wearedevelopers.com/jobs/ext/3937054-ai-site-reliability-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# AI Site Reliability Engineer

- **Company:** Cognizant Technology Solutions Corporation
- **Location:** San Jose, CA, United States
- **Experience:** Experienced
- **Salary:** $142,000.0
- **Contract:** Permanent contract
- **Skills:** Artificial Intelligence, Amazon Web Services, Microsoft Azure, Cloud Computing, Computer Clusters, Nvidia CUDA, Continuous Integration, Linux, DevOps, Disaster Recovery, Identity and Access Management, Python (Programming Language), Load Testing, Machine Learning, Octopus Deploy, Reliability Engineering, Software Reliability Testing, Prometheus, Data Logging, Data Processing, Graphics Processing Unit (GPU), Google Cloud, High Performance Computing, Grafana, Software Troubleshooting, Generative AI, Kubernetes, Infrastructure Automation Frameworks, Low Latency, Deployment Automation, Machine Learning Operations, Terraform, Software Version Control, Data Pipelines, Programming Languages
- **Published:** October 26, 2026
- **Apply:** https://www.sanjosejobsite.com/job.asp?id=3472095867&tx=FR4744FFF&pt=1&aff=0B19D771-A501-4A5E-8338-2A822B784D54&utm_source=Job%20Feed&utm_medium=textkernel&utm_campaign=DE&utm_term=0B19D771-A501-4A5E-8338-2A822B784D54

## About the Role

* 4+ years of experience in SRE, infrastructure engineering, DevOps, platform engineering, or production engineering.
 * Strong Linux, networking, cloud, and distributed-systems experience.
 * Hands-on experience with Kubernetes and infrastructure-as-code tools such as Terraform.
 * Experience with at least one major cloud platform: AWS, Azure, or Google Cloud.
 * Proficiency in Python, Go, or another programming language used for automation and production systems.
 * Experience with observability platforms, metrics, logs, traces, and incident-management practices.
 * Experience operating production services with defined availability and performance targets.
 * Strong troubleshooting, communication, documentation, and systems-thinking skills., * Experience operating machine-learning or generative-AI workloads in production.
 * Familiarity with GPUs, CUDA, model-serving systems, vector databases, or high-performance computing.
 * Experience with tools such as Prometheus, Grafana, OpenTelemetry, Argo CD, Helm, or service meshes.
 * Knowledge of MLOps practices, model lifecycle management, and ML/data pipelines.
 * Experience with reliability testing, chaos engineering, load testing, or capacity modeling.
 * Understanding of AI security, data privacy, model-safety controls, and access management.

## Description

You will work across cloud infrastructure, Kubernetes, GPU compute, model-serving systems, observability, automation, and incident response. You will partner with software, data science, security, and platform teams to ensure our AI systems meet high standards for availability, latency, performance, cost, and operational safety., * Design, operate, and improve highly available infrastructure for AI training, inference, and data-processing workloads.

 * Define and manage service-level objectives, reliability metrics, error budgets, and capacity plans.
 * Build monitoring, logging, tracing, alerting, and AI-specific observability for model-serving platforms.
 * Lead incident response, root-cause analysis, post-incident reviews, and reliability improvements.
 * Automate deployment, scaling, rollback, disaster recovery, and routine operational tasks.
 * Operate Kubernetes-based services, cloud platforms, GPU clusters, networking, storage, and CI/CD systems.
 * Improve model-serving performance, including latency, throughput, GPU utilization, availability, and cost efficiency.
 * Develop safe automation and self-healing workflows for common production issues.
 * Establish operational standards for model versioning, rollouts, canary releases, feature flags, and rollback procedures.
 * Collaborate with engineering and ML teams to make AI systems production-ready.
 * Maintain clear runbooks, architecture documentation, and operational procedures.
 * Participate in an on-call rotation and help build a sustainable, low-noise operational culture.