Production Engineer - AI Storage & HPC Infrastructure

Diverse Lynx LLC
San Jose, CA, United States
3 days ago
Apply on www.careerbuilder.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Compensation
$160,000
Working hours
Regular working hours

Tech stack

Training Data Artificial Intelligence Amazon S3 Data Analysis C++ (Programming Language) Cloud Computing Computer Programming Information Engineering Data Integrity Extract Transform Load (ETL) Data Security Software Debugging
+28 more
Linux Distributed File Systems File Systems Distributed Data Store Distributed Systems Python (Programming Language) Linux System Administration Machine Learning Meta-Data Management Reliability Engineering Strategies of Testing AI Infrastructure Data Logging Cloud Platform System High Performance Computing Data Ingestion System Availability Concurrency Caching Reliability of Systems Infrastructure as Code (IaC) Pure Storage Kubernetes Storage Technologies Low Latency Data Management ZFS File System Terraform

Job description

We are seeking a highly skilled Production Engineer - AI Storage & HPC Infrastructure to support and Eligible to workimize next-generation AI and High-Performance Computing (HPC) environments.

In this role, you will help build, operate, and scale high-performance storage platforms that support large-scale machine learning, AI training, advanced analytics, and distributed computing workloads.

The ideal candidate will combine expertise in storage systems, Linux, automation, performance engineering, and infrastructure operations to ensure reliable and efficient access to critical datasets and model artifacts across enterprise-scale environments.

This is a hands-on engineering role involving storage architecture, performance Eligible to workimization, automation, observability, and production support.

Key Responsibilities

  • Design, deploy, and support distributed file systems and object storage platforms used by large-scale AI, analytics, and HPC workloads.
  • Manage storage environments supporting shared research, analytics, model training datasets, and checkpoint storage requirements.
  • Troubleshoot and Eligible to workimize storage performance across metadata services, throughput, latency, caching, networking, and data-access patterns.
  • Build and maintain automation for provisioning, capacity expansion, upgrades, recovery processes, and lifecycle management.
  • Manage data movement, replication, migration, and synchronization across multiple clusters, regions, and cloud environments while maintaining security and data integrity.
  • Develop tooling and automation to improve storage operations, scalability, monitoring, and reliability.
  • Partner with platform engineering, infrastructure, security, and development teams to ensure highly available and resilient storage services.
  • Participate in on-call support, incident response, root cause analysis, and continuous service improvement initiatives.
  • Implement observability, alerting, health monitoring, testing strategies, and controlled production rollouts.

Requirements

Artificial Intelligence (AI), Artificial Intelligence (AI), Machine Learning, Distributed Computing, Training Data Sets, Performance Engineering, Linux Operating System, Automation, Storage Architecture, Production Support, * Strong experience designing, operating, or supporting large-scale distributed storage platforms, high-performance file systems, or enterprise data infrastructure.

  • Deep hands-on Linux administration and troubleshooting experience.
  • Strong understanding of file systems, storage protocols, networking, concurrency, and performance Eligible to workimization.
  • Experience diagnosing production issues related to storage performance, data access, throughput bottlenecks, and system reliability.
  • Hands-on programming or automation experience using one or more of the following:
  • Python
  • Go
  • C++
  • Rust
  • Experience driving end-to-end reliability improvements, performance Eligible to workimization initiatives, or large-scale operational enhancements.
  • Strong debugging, analytical, and problem-solving skills.
  • Experience working in highly available production environments with operational ownership responsibilities., * Experience with Kubernetes, container orchestration platforms, and cloud-native infrastructure.
  • Strong understanding of distributed filesystem concepts including metadata management, caching, consistency, failover, recovery, and high availability.
  • Hands-on experience with one or more enterprise storage technologies such as:
  • Lustre
  • ZFS / OpenZFS
  • VAST Data
  • Pure Storage
  • Hammerspace
  • Similar large-scale distributed storage platforms
  • Experience supporting AI, Machine Learning, Data Engineering, or HPC infrastructures.
  • Understanding of high-throughput data ingestion, checkpoint management, data staging, and accelerator-cluster storage requirements.
  • Experience with Infrastructure as Code (IaC) and automation tools including:
  • Terraform
  • Helm
  • Kubernetes Operators
  • Experience implementing observability and monitoring solutions using metrics, logging, tracing, benchmarking, and capacity-planning tools.
  • Familiarity with object storage technologies, S3-compatible storage, lifecycle management, tiering, replication, and cross-region data movement.

Preferred Profile

  • 5+ years of experience in Storage Engineering, Platform Engineering, Site Reliability Engineering (SRE), Infrastructure Engineering, HPC Operations, or Cloud Infrastructure.
  • Experience in enterprise-scale production environments supporting mission-critical workloads.
  • Strong communication skills and ability to collaborate with globally distributed engineering teams.
  • Self-driven engineer with a passion for automation, reliability, scalability, and operational excellence.

Please fill below matrix and share with your updated resume.

Skill Years Of Experience Linux Administration Distributed Storage Technologies Lustre / ZFS / VAST / Pure / Hammerspace Python Automation Kubernetes Cloud Infrastructure Terraform / Infrastructure as Code Storage Performance Tuning Incident Management & RCA Monitoring & Observability HPC Environment Experience AI Infrastructure Experience

About the company

Security Notice: Our official website is www.diverselynx.com We do not operate or authorize any other websites representing Diverse Lynx LLC.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerbuilder.com
Prepare application

Good distractions

Loading talks and stories from around this role…