Agentic AI Infrastructure Lead: Linux and System Platform Senior Leadership

Phison Technology Inc.
San Jose, CA, United States
about 1 month ago
Apply on www.indeed.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
7 years minimum
Compensation
$140,000.0 - $200,000.0
Working hours
Regular working hours
Job source

Tech stack

Application Programming Interfaces (APIs) Artificial Intelligence Computing Platforms Continuous Integration Data Centers Linux Device Drivers Distributed Data Store Firmware Hardware Design Linux Kernel Linux Security Modules
+11 more
Performance Tuning Software Engineering Ceph (Software) Large Language Models Backend Selinux Kubernetes TensorRT Virtual Agents U-Boot Nvme

Job description

Every controller and drive we ship is designed entirely in-house. Our products power data centers, enterprise infrastructure, consumer devices, and embedded systems around the world and in space. We are now building an intelligent storage appliance that deploys custom AI models directly at the storage layer. This role leads that effort, with the rare added benefit of direct input into Phison SSD hardware design to optimize our products for AI inference workloads. As a Lead, you will grow the team as the platform evolves and our customer base expands., * Lead the architecture and delivery of a Linux-based AI storage appliance - from kernel interfaces to management APIs.

  • Collaborate with partners on LLM deployment at scale: inference serving, optimization pipelines, and production operations with real SLA requirements.
  • Implement LLM execution optimizations based on Phison aiDAPTIV technology including KV cache offload to NVMe, quantization, batching, and fine-tuning workflows.
  • Work with Phison’s in-house hardware and firmware teams to shape Computational SSD and controller design for AI inference workloads.
  • Lead and grow a cross-functional team of Linux and full stack engineers - hiring, mentoring, and delivery ownership., * As a leader at Phison, you will be supported by executive partnership and cross-functional collaboration. You won’t be operating alone.
  • We invest in our leaders through mentorship, peer collaboration, and clear decision-making frameworks.
  • We also value engineers who are comfortable working at the edge of what’s known, asking questions, testing hypotheses, and learning quickly in emerging technical spaces.

Requirements

7+ years development, with experience leading teams, * 7+ years of Linux-focused software development, and experience leading or growing a technical team, whether through a formal management title or by driving cross-functional delivery, mentoring, or project leadership.

  • Proven commercial track record - at least two products shipped from development through to market.
  • Hands-on expertise in LLM deployment at scale and inference optimization (vLLM, TensorRT-LLM, llama.cpp, or equivalent).
  • Practical experience with KV cache offload to storage, quantization (GPTQ/AWQ/GGUF), and LLM fine-tuning (LoRA/QLoRA).
  • Strong Linux full stack skills: systems-level C/C++/Go/Rust, backend services, container orchestration, and CI/CD., * Linux kernel development, device drivers, or NVMe storage internals.
  • Linux security hardening (SELinux, AppArmor, secure boot) or networking stack internals.
  • Distributed storage platforms (Ceph, GlusterFS, or equivalent).

Benefits & conditions

Pulled from the full job description

  • Parental leave
  • 401(k)
  • Health insurance
  • 401(k) matching
  • Paid time off
  • Vision insurance
  • Dental insurance, Compensation ranges reflect base salary, final compensation will be determined in good faith based on a variety of factors, including the candidate’s relevant experience, specialized skills, education, and geographic location. Candidates in certain markets may fall outside the range listed. This range reflects base pay only and does not include potential bonuses or our comprehensive benefits., We offer a competitive benefits package including medical, dental, and vision insurance, 401(k) with company match, paid time off, and more. View our full benefits at https://www.phisonenterprise.com/careers/

Equal Opportunity Employer - We encourage candidates to still apply, even if you don’t meet 100% of the qualifications. Phison Electronics is committed to a diverse, inclusive, and equitable workplace. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability, veteran status, or any other characteristic protected by applicable law.

Pay: $140,000.00 - $200,000.00 per year, * 401(k)

  • 401(k) matching
  • Dental insurance
  • Flexible spending account
  • Health insurance
  • Life insurance
  • Paid time off
  • Parental leave
  • Vision insurance

About the company

Phison Electronics is a global leader in NAND flash controllers and storage solutions, powering more than one in every five SSDs shipped worldwide. Phison has grown into a multi-billion-dollar company with over 4,500 employees - 70% of which are dedicated to R&D - and more than 2,000 patents. The company’s innovations include aiDAPTIV+, an award-winning AI solution for affordable LLM training and inferencing on-premises, and Pascari, a portfolio of ultra-high-performance enterprise SSDs purpose-built for data-intensive workloads across AI, cloud, and hyperscale data centers.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.indeed.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

52 sec

Running persistent Linux environments directly on Windows

Ben Breard Ben Breard · World Congress 2025

1:34 min

Pivoting careers into specialized platform engineering roles

Xavier Portilla Edo · LIVE

1:24 min

Comprehensive AI infrastructure stacks at the Linux Foundation

Matt White Matt White · World Congress 2025

3:55 min

Demonstrating .NET installation on Debian and Azure Linux

Silvano Coriani Silvano Coriani · Europe 2026 Virtual

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

8:22 min

Simulating a Linux terminal and running Spring Boot

Jakov Semenski · LIVE

Videos

See all

Related articles

See all