> Markdown version of [/jobs/ext/2697284-cluster-site-reliability-engineer-sre](https://www.wearedevelopers.com/jobs/ext/2697284-cluster-site-reliability-engineer-sre). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Cluster Site Reliability Engineer (SRE)

- **Company:** The Voleon Group
- **Location:** Berkeley, CA, United States
- **Experience:** Expert
- **Salary:** $15,000.0
- **Contract:** Permanent contract
- **Skills:** Java (Programming Language), Artificial Intelligence, Airflow, Amazon Web Services, Amazon S3, Systems Engineering, Cloud Computing, Configuration Management, DevOps, Distributed Computing Environment, Distributed Data Store, Distributed Systems, Identity and Access Management, InfiniBand, Python (Programming Language), Machine Learning, Remote Direct Memory Access, Reliability Engineering, Ansible, Tensorflow, Prometheus, Ruby, Zero Trust Network Access, Extensible Markup Language (XML), Ceph (Software), Scripting, Google Cloud, Pytorch, Grafana, Apache Spark, Kubernetes, Infrastructure Automation Frameworks, Information Technology, Dask, Data Management, Slurm, Machine Learning Operations, Multiaccess Edge Computing, Terraform, Docker
- **Published:** September 3, 2026
- **Apply:** https://www.careerbuilder.com/job-details/senior-cluster-site-reliability-engineer-berkeley-ca--e8cb4b6c-2d5f-4692-a551-09e1a011f91c

## About the Role

* 5+ years of experience in SRE or DevOps roles, preferably working as a senior engineer or tech lead
 * Knowledge of HPC/batch compute frameworks (Slurm, Kueue, AWS/GCP Batch) and/or machine learning training systems (Kubeflow, MLflow, Horovod)
 * Ability to develop scripts and utilities of moderate complexity in a common scripting language (Python, Ruby, etc.)
 * Familiarity with infrastructure-as-code and configuration management tools (Terraform, Ansible)
 * Experience with cloud infrastructure (AWS or GCP)
 * Familiarity designing and implementing modern observability stacks (Prometheus, Grafana, Loki, ELK, OpenTelemetry)
 * Experience with distributed storage technologies (Lustre, Ceph, S3)
 * Embodies a "system engineer" rather than "system administrator" mindset, thinking systematically and leveraging automation
 * Bachelor degree in computer science, * Hands-on experience with HPC frameworks (Slurm, Grid Engine) and Kubernetes-based job orchestrators (Airflow, Kueue, Kubeflow Pipelines), along with other distributed computing frameworks (Ray, Modin, Dask, Spark)
 * Familiarity with ML frameworks (PyTorch/Tensorflow, JAX, Horovod, DeepSpeed)
 * Familiarity with hybrid/on-prem environments
 * Experience with containerization (Docker, Podman, Singularity), particularly for HPC/batch compute environments
 * Experience with HPC networking (InfiniBand, RDMA)
 * Solid security/IAM foundations (Identity management systems, AWS/GCP IAM, Zero Trust), Amazon Simple Storage Service (S3), Amazon Web Services (AWS), Ansible, Architectural Services, Artificial Intelligence (AI), Asset Management, Automation, Cloud Computing, Compensation and Benefits, Computer Science, Configuration Management, DevOps, Distributed Computing, Engineering, Federal Laws and Regulations, Finance, Forecasting, GCP (Good Clinical Practices), Genetics, Identify Issues, Identity Data Management, Investment Management, JAX (Java API for XML), Machine Learning, Metrics, Problem Solving Skills, Python Programming/Scripting Language, Reliability Engineering, Research & Development (R&D), Ruby, Scripting (Scripting Languages), Service Level Agreement (SLA), Systems Administration/Management, Systems Engineering, Technical Leadership, Telemetry, Usability Engineering

## Description

As a Senior Cluster Site Reliability Engineer (SRE), you will help scale our research compute cluster to meet our growing needs, and you will leverage engineering skills to ensure high degrees of uptime, reliability, and robustness. Our research clusters are at the core of our R&D, and you will be directly responsible for keeping this key resource available and performant. Your work will provide a world-class HPC platform for researchers to focus on cutting-edge machine learning problems at scale. You will support both on-prem and cloud infrastructure, and work to provide the best experience to our technical staff. You will leverage IaC, Automation, and SRE principles to refine and hone a product that operates 24/7 to support Voleon.

The Cluster Operations team works on the frontline to triage and mitigate real-time operational issues. You will be an integral member of this team, solving day-to-day issues with high urgency, while also engineering systemic improvements and architectural fixes to prevent recurring issues. You will collaborate with engineering teams to develop improvements to monitoring/telemetry. You will help design and oversee operational frameworks to ensure the cluster operates within a set of rigorous SLAs.

Responsibilities

 * Be a first responder in the event of cluster outages or issues. Triage and resolve urgent issues as they arise
 * Ensure a high degree of cluster uptime (measured in multiple nines), and define + track SLAs to quantify reliability
 * Diagnose systemic/recurring patterns of problems, and engineer precision solutions to them in collaboration with engineering teams
 * Develop robust metrics and observability for cluster health and use those metrics to inform your work. Build out custom observability mechanisms when off-the-shelf ones won't do
 * Help software and research teams design policies around fair cluster usage, and help develop enforcement mechanisms for said policies
 * Assist in forecasting cluster growth, and help select appropriate scale-up strategies. Help optimize operations across dimensions of cost and usability


## Related Videos

- [Running Secure Life Science Research at Scale using Hybrid GPU HPC and Kubernetes 🧬](https://www.wearedevelopers.com/videos/100355-running-secure-life-science-research-at-scale-using-hybrid-gpu-hpc-and-kubernetes)
- [Coffee with Developers: David Heinemeier Hansson](https://www.wearedevelopers.com/videos/875-coffee-with-developers-david-heinemeier-hansson)
- [SRE Methods In an Agency Environment](https://www.wearedevelopers.com/videos/348-sre-methods-in-an-agency-environment)
- [Coroutine explained yet again 60 years later](https://www.wearedevelopers.com/videos/690-coroutine-explained-yet-again-60-years-later)
- [Leading with Reliability: Applying SRE Principles to Build Stronger Engineering Organizations](https://www.wearedevelopers.com/videos/100185-leading-with-reliability-applying-sre-principles-to-build-stronger-engineering-organizations)
- [Fireside Chat with Werner Vogels, VP & CTO, Amazon.com & Daniel Gebler, CTO at Picnic](https://www.wearedevelopers.com/videos/1405-fireside-chat-with-werner-vogels-vp-cto-amazon-com-daniel-gebler-cto-at-picnic)

## Related Articles

- [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Is Software Engineering Over-Saturated?](https://www.wearedevelopers.com/magazine/418-is-software-engineering-over-saturated)
- [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers)
- [Résumé-Driven Development: How IT trends affect the job market for software developers](https://www.wearedevelopers.com/magazine/59-resume-driven-development-how-it-trends-affect-the-job-market-for-software-developers)
- [Best US AI Conferences for CTOs in 2026: Build vs. Buy, Vendor Evaluation, and Peer Intelligence](https://www.wearedevelopers.com/magazine/736-best-us-ai-conferences-for-ctos-in-2026-build-vs-buy-vendor-evaluation-and-peer-intelligence)