Senior Storage Engineer, AI Infrastructure in San Jose

Energy Jobline
San Jose, CA, United States
2 days ago
Apply on www.energyjobline.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Compensation
$175,000 - $255,000
Working hours
Regular working hours

Tech stack

Amazon S3 Bash Shell Customer Data Management Extract Transform Load (ETL) Linux Digital Architecture Disaster Recovery RAID File Systems Distributed Data Store General Parallel File Systems Storage Area Network (SAN)
+14 more
Python (Programming Language) Network File Systems Remote Direct Memory Access Weka AI Infrastructure Ceph (Software) Scripting Software Troubleshooting Pure Storage Kubernetes Data Management Slurm Data Pipelines Nvme

Job description

Build storage systems that keep AI training and inference workloads supplied with data. You’ll design, operate, and tune high-throughput storage - from parallel file systems to object storage - while balancing performance, availability, capacity, and cost. You’ll have a direct role in ensuring storage can keep pace with GPU compute and recover predictably when things go wrong.

What you’ll do

  • Deploy and operate parallel or distributed storage platforms such as Lustre, WEKA, Ceph, or GPFS, based on business and workload needs.

  • Tune throughput, latency, metadata performance, and concurrency for data loading, checkpointing, and large-scale training workflows.

  • Plan capacity, data placement, tiering, and lifecycle across NVMe, SSD, HDD, and object storage.

  • Design and maintain monitoring, alerting, backup, snapshots, replication, and disaster-recovery procedures.

  • Troubleshoot storage and filesystem issues across Linux hosts, clients, networks, and storage nodes.

  • Integrate storage with Slurm, Kubernetes, and customer data workflows in partnership with compute and network teams.

  • Evaluate technologies and vendors; document architecture, operational runbooks, maintenance plans, and capacity forecasts.

Requirements

5+ years of storage engineering or infrastructure experience in production environments.

  • Production experience with at least one distributed or parallel file system, such as Lustre, Ceph, WEKA, or GPFS.

  • Strong Linux storage fundamentals, including NVMe, RAID, filesystems, NFS, and performance troubleshooting.

  • Experience with S3-compatible or other object storage in a production setting.

  • Ability to diagnose I/O performance issues using metrics, workload characteristics, and system-level evidence.

  • Python, Bash, or comparable scripting skills for automation and operational tooling.

Helpful, but not required

  • RDMA, NVMe-oF, or high-performance storage networking.

  • Experience designing storage for large GPU/HPC clusters or high-concurrency data pipelines.

  • VAST Data, DDN, Pure Storage, or comparable enterprise storage platforms.

  • Experience with capacity forecasting, resilience testing, and disaster-recovery exercises.

How success will be measured

Predictable storage performance under real workloads, clear capacity planning, fewer recurring incidents, and tested recovery procedures.

Benefits & conditions

The base salary range for this role in San Jose, California is $175,000 - $255,000 per year. The range shown is a good-faith estimate of the base salary we reasonably expect to pay for this role in this location. Actual compensation will depend on experience, skills, qualifications, and internal equity. This role may also be eligible for additional compensation and benefits, to be confirmed at the offer stage.

About the company

ARC Cloud Inc is an AI infrastructure company building and operating GPU cloud and data center capacity for AI training and inference workloads. Our teams design and run the network, storage, and cluster platforms that keep large GPU clusters performing reliably for customers.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.energyjobline.com
Prepare application

Good distractions

Loading talks and stories from around this role…