> Markdown version of [/jobs/ext/4359735-sr-principal-devops-engineer-aiops](https://www.wearedevelopers.com/jobs/ext/4359735-sr-principal-devops-engineer-aiops). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Sr Principal DevOps Engineer (AIOps)

- **Company:** Palo Alto Networks
- **Location:** Santa Clara, CA, United States
- **Experience:** Expert
- **Salary:** $177,500.0 - $287,100.0
- **Contract:** Permanent contract
- **Skills:** Amazon Web Services, Systems Engineering, Continuous Integration, Software Debugging, Linux, DevOps, Distributed Systems, Elasticsearch, Apache Hadoop, Python (Programming Language), MongoDB, MySQL, Reliability Engineering, Ansible, Tensorflow, Prometheus, Shell Script, Vault (Revision Control System), Spinnaker, Datadog, Google Cloud, Grafana, Mttr, Multi-Cloud, Gitlab, Kubernetes, Palo Alto Networks, Apache Kafka, Terraform, AIOps, Docker, Golang
- **Published:** October 31, 2026
- **Apply:** https://www.indeed.com/viewjob?jk=cb5d84a083ab0cd5

## About the Role

Your Experience

 * 12-15+ years in Infrastructure, SRE, DevOps, or Systems Engineering
 * 8-10+ years building and operating large-scale distributed systems on AWS/GCP
 * Proven experience driving cross-team or org-level technical initiatives
 * Strong expertise in Terraform, Helm, or similar IaC frameworks
 * Deep experience in automation (Python, Go, shell scripting)
 * Strong hands-on expertise in Kubernetes at scale
 * Advanced knowledge of Linux, networking, and distributed systems debugging
 * Experience with CI/CD (GitLab) and GitOps (ArgoCD)
 * Strong background in observability (Prometheus, Grafana, Loki, tracing)
 * Ability to lead incident management and complex production troubleshooting
 * Excellent communication skills; ability to influence directors and VPs
 * Demonstrated leadership in mentoring and setting engineering standards
 * Strong ownership, with focus on scalability, reliability, and long-term architecture

## Description

Palo Alto Networks runs a large hybrid infrastructure and is one of the largest GCP customers. As a Sr Principal DevOps Engineer, you will be part of a team supporting the services running on this infrastructure. This includes automation, architecture, performance, metrics, troubleshooting, security, and reliability.

Our stack includes Kubernetes, Docker, GCP, AWS, Ansible, Terraform, Vault, Gitlab, Spinnaker, Tensorflow, Datadog, Elasticsearch, Kafka, Hadoop, MySQL, Percona, MongoDB, Python, and Go. We don't expect you to know all these, but we do expect you to learn the ones needed for this role.

Your Impact

 * Define and drive org-level SRE and platform engineering strategy
 * Architect multi-region, multi-cloud (GCP & AWS) highly available systems
 * Establish SLO/SLI standards, error budgets, and reliability governance across teams
 * Lead design of platform abstractions (Terraform modules, Kubernetes platforms, GitOps)
 * Drive end-to-end observability architecture and reduce MTTR at scale
 * Ensure services are production-ready, scalable, secure, and cost-optimized
 * Lead SEV-1 incidents, RCA, and executive-level communication
 * Influence product and engineering teams on architecture and reliability decisions
 * Mentor senior engineers and act as a technical authority across orgs
 * Drive automation, self-service platforms, and operational excellence