> Markdown version of [/jobs/ext/1343952-senior-staff-engineer-ai-data-path](https://www.wearedevelopers.com/jobs/ext/1343952-senior-staff-engineer-ai-data-path). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Staff Engineer - AI Data Path - **Company:** DDN, LLC - **Location:** Sacramento, CA, United States - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Automated Storage and Retrieval Systems, C++ (Programming Language), Cloud Engineering, Profiling, Data Transmissions, Extract Transform Load (ETL), Software Debugging, Linux, File Systems, Distributed Data Store, Distributed Systems, General-Purpose Computing on Graphics Processing Units, InfiniBand, Python (Programming Language), Machine Learning, Performance Tuning, Remote Direct Memory Access, Reliability Engineering, Tensorflow, AI Infrastructure, Pytorch, Large Language Models, Caching, Generative AI, Data Layers, Storage Technologies, Information Technology, Low Latency, Performance Monitor, Nvme - **Published:** July 19, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=16b880f9e221bf55 ## About the Role * Bachelor's or Master's degree in Computer Science, Engineering, or a related field. * 12+ years of experience in storage systems, distributed systems, or performance engineering. * Proven track record of architecting and delivering large-scale, high-performance infrastructure systems. * Deep expertise in distributed storage architectures (object storage, scalable file systems, or cloud-native storage platforms). * Strong understanding of Linux I/O stack, filesystem internals, and storage protocols. * Extensive hands-on experience with NVMe, SSD optimization, and high-performance storage environments. * Strong experience with RDMA, InfiniBand, or other high-speed data transfer technologies. * Solid understanding of GPU computing concepts and CPU-GPU data movement patterns. * Proficiency in Python and/or C/C++, with advanced debugging, profiling, and performance tuning skills. * Demonstrated ability to optimize latency-sensitive, high-throughput production systems. Preferred Skills * Hands-on experience with NVIDIA NIXL or similar data movement frameworks. * Experience with GPU-aware storage pipelines and GPUDirect Storage. * Strong understanding of AI inference systems, LLM serving architectures, and KV cache optimization. * Experience with Retrieval-Augmented Generation (RAG) pipelines and open vector search ecosystems. * Background in high-performance computing (HPC) or hyperscale distributed environments. * Expertise in caching strategies, memory tiering, and data locality optimization. * Experience designing disaggregated compute and storage architectures. What You'll Work On * Leading the evolution of storage systems into GPU-native data layers for AI inference * Building next-generation distributed AI infrastructure using NIXL and Infinia * Driving performance breakthroughs in real-time LLM inference at scale * Designing storage architectures for large-scale AI datasets and retrieval systems ## Description * Lead the design and implementation of high-performance data movement pipelines using NVIDIA NIXL across GPU, CPU, and storage tiers. * Architect and drive integration of DDN Infinia with GPU-accelerated inference platforms for large-scale, real-time AI workloads. * Own end-to-end optimization of I/O paths between GPU memory and storage using technologies such as NVIDIA GPUDirect Storage, RDMA, and NVMe-over-Fabrics. * Define and implement multi-tier storage architectures (NVMe, SSD, object storage) optimized for inference latency, throughput, and scalability. * Lead development of advanced KV cache management strategies, including offloading, prefetching, and persistence across distributed storage layers. * Partner with AI/ML engineering teams to optimize inference performance in frameworks such as PyTorch and TensorFlow. * Establish benchmarking frameworks and lead performance tuning efforts for storage and data movement in production inference environments. * Diagnose and resolve complex system bottlenecks across storage, networking, and GPU subsystems. * Influence architecture decisions for distributed inference systems, ensuring scalability, resilience, and efficient data locality. * Drive engineering excellence through best practices in observability, performance monitoring, automation, and reliability engineering. * Mentor junior engineers and provide technical leadership across cross-functional teams. ## Related Videos - [Your Next AI Needs 10,000 GPUs. Now What?](https://www.wearedevelopers.com/videos/1590-your-next-ai-needs-10-000-gpus-now-what) - [HTTP headers that make your website go faster](https://www.wearedevelopers.com/videos/1676-http-headers-that-make-your-website-go-faster) - [Docker network without Docker](https://www.wearedevelopers.com/videos/1418-docker-network-without-docker) - [Building the Nervous System of AI - Michael Kagan (NVIDIA)](https://www.wearedevelopers.com/videos/2133-building-the-nervous-system-of-ai-michael-kagan-nvidia) - [Event based cache invalidation in GraphQL](https://www.wearedevelopers.com/videos/433-event-based-cache-invalidation-in-graphql) - [Docker exec without Docker](https://www.wearedevelopers.com/videos/1094-docker-exec-without-docker) ## Related Articles - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Best US AI Conferences for CTOs in 2026: Build vs. Buy, Vendor Evaluation, and Peer Intelligence](https://www.wearedevelopers.com/magazine/736-best-us-ai-conferences-for-ctos-in-2026-build-vs-buy-vendor-evaluation-and-peer-intelligence) - [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development) - [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud) - [Graph and AI Trends 2026: Why Is AI Running but Not Yet Delivering?](https://www.wearedevelopers.com/magazine/680-graph-and-ai-trends-2026-why-is-ai-running-but-not-yet-delivering)