> Markdown version of [/jobs/ext/2573023-product-manager-ai-sw-infrastructure-ai-software-stack-compiler-platform-us](https://www.wearedevelopers.com/jobs/ext/2573023-product-manager-ai-sw-infrastructure-ai-software-stack-compiler-platform-us). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Product Manager - AI SW Infrastructure (AI Software Stack / Compiler / Platform) - US - **Company:** Majestic Labs LLC - **Location:** Los Altos, CA, United States - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Application Programming Interfaces (APIs), Artificial Intelligence, Amazon Web Services, Systems Engineering, Basic Linear Algebra Subprograms, C++ (Programming Language), Cloud Computing, Cluster Analysis, Nvidia CUDA, Data Centers, Distributed Systems, Memory Management, Interoperability, Network Protocols, Open Source Technology, Performance Tuning, Tensorflow, Software Systems, System Software, Toolchain, AI Infrastructure, Multithreading, Pytorch, Deep Learning, Parallel Computation, Information Technology, HuggingFace, Slurm - **Published:** August 2, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=6c5876b788a582a3 ## About the Role * Education: Master of Science (M.Sc.) or Doctor of Philosophy (Ph.D.) in Computer Science, Electrical Engineering, Mathematics, or Physics is a strict, non-negotiable requirement. * AI Software Stack Expertise: Minimum of 5 to 8 years of experience in product management or software systems engineering, with a proven track record of shipping compiler technologies, deep learning frameworks, or developer platform tools. * Parallel Programming Fluency: Deep theoretical and practical understanding of CUDA, Triton, high-performance C++ DSP libraries, and multi-threaded parallel computation paradigms. * Scale-Out Infrastructure Knowledge: Demonstrated familiarity with HPC scale-out infrastructures, distributed memory architectures, and networking protocols designed for high-performance clustering. * Prior experience at accelerated software, cloud, or startup organizations building complex AI compute systems, such as NVIDIA, Meta, Google, AWS, SambaNova, Cerebras, Groq, or Lightning AI. Preferred Qualifications * MBA or equivalent experience in technology commercialization or product strategy. * Active contributions to open-source AI infrastructure projects, compilers (MLIR/LLVM), or performance optimization libraries. * Direct experience working inside a frontier AI lab or foundation model organization (e.g., OpenAI, Anthropic, xAI, Google DeepMind) developing large-scale distributed systems. ## Description We're a fast-moving, US-Israeli AI startup building next-generation infrastructure for the world's most demanding AI workloads. Our mission is to accelerate the future of intelligence and make it ubiquitously accessible by delivering full stack custom AI servers optimized for large-scale inference and training. Backed by top-tier investors and led by industry veterans, we're scaling rapidly. We seek forward-thinking engineers and operators who thrive in a collaborative environment and excel at solving complex challenges from first principles. If you want to build infrastructure that fundamentally changes what the world can accomplish with AI, come join us! About the position We are building the next generation of AI infrastructure-from custom silicon to the servers and systems that power the world's largest AI models. Our vertically integrated approach enables us to optimize every layer of the AI compute stack, delivering breakthrough performance, efficiency, and scalability. We're looking for a visionary, highly technical Senior Product Manager who thrives at the intersection of data center infrastructure, server-grade hardware and software, systems engineering, and AI to lead our AI software stack, compiler platform, and server system software. This role is responsible for defining and delivering the software ecosystem that makes Majestic's system completely seamless for developers and cloud infrastructure teams. You will own the compiler roadmap, runtime engines, and framework integrations that translate standard deep learning model representations into highly optimized execution paths on the Ignite APU. Responsibilities * Translate customer, engineering, and business requirements into detailed Product Requirements Documents (PRDs), technical specifications, and feature definitions. * Develop detailed product schedules, milestone plans, and release timelines while managing dependencies across multiple engineering organizations. * Compiler Pipeline and Toolchain Roadmap: Define requirements for the software and AI model compilation toolchain * Framework Integration and Interoperability: Lead product partnerships and technical integrations with major machine learning frameworks and runtimes, ensuring native support for PyTorch, JAX, vLLM, SGLang, and Hugging Face Optimum without requiring customer code modifications. * High-Performance Kernel Optimization Roadmap: Define performance optimization roadmap for low-level operator libraries, including BLAS, custom OpenAI Triton kernels * Scale-Out and Clustering Orchestration: Define requirements for clustering and multi-node scale-out configurations, ensuring seamless execution across scale-out setups utilizing SLURM, Ray, LMCache, etc. * Developer Platform Usability: Act as the primary advocate for developer experience, monitoring how software compiles and executes in customer sandboxes, and proactively removing the need for manual memory management scripts, custom compiler hacks, or API wrappers. ## Related Videos - [Shipping Faster with Less: Render on Cloud Hosting, AI Workloads, and the Future of DevOps](https://www.wearedevelopers.com/videos/1894-shipping-faster-with-less-render-on-cloud-hosting-ai-workloads-and-the-future-of-devops) - [Speeding up Web Apps performance with WebAssembly and Emscripten](https://www.wearedevelopers.com/videos/1985-speeding-up-web-apps-performance-with-webassembly-and-emscripten) - [Running Secure Life Science Research at Scale using Hybrid GPU HPC and Kubernetes 🧬](https://www.wearedevelopers.com/videos/100355-running-secure-life-science-research-at-scale-using-hybrid-gpu-hpc-and-kubernetes) - [Photonic Computing: Programming a New Class of AI Accelerators (incl. Live Coding)](https://www.wearedevelopers.com/videos/100196-photonic-computing-programming-a-new-class-of-ai-accelerators-incl-live-coding) - [Coffee with Developers - Maria Apazoglou](https://www.wearedevelopers.com/videos/1209-coffee-with-developers-maria-apazoglou) - [The Power of Developer Communities](https://www.wearedevelopers.com/videos/1109-the-power-of-developer-communities) ## Related Articles - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [MLOps – What’s the deal behind it?](https://www.wearedevelopers.com/magazine/125-mlops-what-s-the-deal-behind-it) - [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development) - [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift) - [Stephan Gillich - Bringing AI Everywhere](https://www.wearedevelopers.com/magazine/489-stephan-gillich-bringing-ai-everywhere) - [Best US AI Conferences for CTOs in 2026: Build vs. Buy, Vendor Evaluation, and Peer Intelligence](https://www.wearedevelopers.com/magazine/736-best-us-ai-conferences-for-ctos-in-2026-build-vs-buy-vendor-evaluation-and-peer-intelligence)