> Markdown version of [/jobs/ext/2600966-senior-site-reliability-engineer-storage](https://www.wearedevelopers.com/jobs/ext/2600966-senior-site-reliability-engineer-storage). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Site Reliability Engineer - Storage - **Company:** Lambda Inc. - **Location:** San Francisco, CA, United States (Remote available) - **Experience:** Expert - **Salary:** $267,000.0 - $356,000.0 - **Contract:** Permanent contract - **Skills:** Application Programming Interfaces (APIs), Amazon S3, Continuous Integration, Data Centers, Linux, Github, General Parallel File Systems, InfiniBand, Python (Programming Language), Kernel-Based Virtual Machine, NetApp Applications, Open Source Technology, Quick EMUlator (QEMU), Remote Direct Memory Access, Reliability Engineering, Ansible, Prometheus, SQL Databases, System Programming, Systems Integration, Transmission Control Protocol (TCP), Weka, Ceph (Software), Datadog, Data Logging, Computer Networking Systems, High Performance Computing, Grafana, Mttr, Break Fix, Containerization, Kubernetes, Data Management, Sumo Logic (Software), Multiaccess Edge Computing, Terraform, Docker, Jenkins, Nvme - **Published:** August 9, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=d9e2bb604f3f45fc ## About the Role * 5+ years of experience operating Linux systems in production or HPC environments, with hands-on storage experience at scale on scale-out or software-defined platforms (e.g., CEPH, Lustre, GPFS, or similar). * Hands-on experience operating Software-Defined Storage (SDS) platforms at scale, including integrating with their management and data-plane APIs. * Strong incident-response instincts: comfortable owning a production storage incident end to end, from first alert through root cause to postmortem. * Working experience with monitoring and logging platforms such as Prometheus, Grafana, Alertmanager, Datadog, or SumoLogic - including building dashboards and alert/pager routing for multiple audiences. * Working experience with Kubernetes (GitOps tooling such as ArgoCD, Helm/Kustomize) and hands-on troubleshooting. * Working experience with CI/CD tooling (GitHub Actions, Jenkins, BuildKite), containerization (Docker/Podman), and systems programming in Python or Go. * Working experience with Infrastructure as Code (Terraform, Ansible). * Solid understanding of core storage protocols across file (NFS, SMB), object (S3), block (NVMe-oF/TCP), and structured (vector DB, SQL) storage. Nice to Have * Experience with cutting-edge software-defined storage solutions such as VAST or Weka. * Enterprise storage expertise in solutions such as NetApp, Dell PowerScale, GPFS, or Lustre. * Experience writing or operating Kubernetes CSI drivers. * Experience with SR-IOV and virtualization (KVM/QEMU). * Experience with GPUDirect Storage, RDMA, InfiniBand, or RoCE networking. * Familiarity with NIC-level diagnostics (ethtool, mlxlink) and fleet-wide operations tooling (clush or similar). * Contributions to open-source storage projects. ## Description * Own the reliability, performance, and capacity health of Lambda's production storage fleet across all data centers, operating behind Lambda's own software-defined data plane. * Build and maintain monitoring, dashboards, and alerting for storage performance, capacity, and hardware failures. * Investigate and resolve storage-related incidents using deep telemetry, logs, and performance profiling - from a single flapping NIC to a cluster-wide rebuild. * Automate ticketing, escalation, and incident-response workflows so the team spends less time on repetitive triage and more time on root cause. * Design and maintain self-healing automation for common failure modes: drive replacement, node swaps, rebuild monitoring, and capacity rebalancing. * Implement CI/CD pipelines for storage automation and tooling. * Partner with Storage Engineers, Fleet Orchestration, and Release Engineering to automate the deployment and configuration of software-defined storage across new and existing sites using tools such as Ansible, Jenkins etc. * Work with hardware and networking teams to diagnose low-level I/O and network issues - NIC errors, RDMA/RoCE/InfiniBand fabric health, path multipathing - that surface as storage-layer symptoms. * Participate in an on-call rotation supporting Lambda's storage fleet, with a focus on driving down MTTR and building the automation that keeps you from getting paged for the same thing twice. ## Related Videos - [What Developers Get Wrong About Application Quality](https://www.wearedevelopers.com/videos/233-what-developers-get-wrong-about-application-quality) - [It's all about the Data](https://www.wearedevelopers.com/videos/425-it-s-all-about-the-data) - [Shipping Faster with Less: Render on Cloud Hosting, AI Workloads, and the Future of DevOps](https://www.wearedevelopers.com/videos/1894-shipping-faster-with-less-render-on-cloud-hosting-ai-workloads-and-the-future-of-devops) - [How I saved 200K/yr in direct costs writing 0 code lines in K8s](https://www.wearedevelopers.com/videos/1055-how-i-saved-200k-yr-in-direct-costs-writing-0-code-lines-in-k8s) ## Related Articles - [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [What does the history of data storage tell us about the future?](https://www.wearedevelopers.com/magazine/495-what-does-the-history-of-data-storage-tell-us-about-the-future) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)