> Markdown version of [/jobs/ext/4746977-vice-president-machine-learning-systems-compiler-engineering](https://www.wearedevelopers.com/jobs/ext/4746977-vice-president-machine-learning-systems-compiler-engineering). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Vice President, Machine Learning & Systems Compiler Engineering - **Company:** INTERNATIONAL RECRUITING LLC - **Location:** United States - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Application Programming Interfaces (APIs), Artificial Intelligence, Computing Platforms, Systems Engineering, Automation of Tests, C++ (Programming Language), CMake, Code Review, Continuous Integration, Data Structures, Software Debugging, Linux, Industry Standard Architecture, Python (Programming Language), Machine Learning, Open Source Technology, Tensorflow, Reduced Instruction Set Computing, Toolchain, Graphics Processing Unit (GPU), Pytorch, Optimization Algorithms, Machine Learning Operations, Api Management, Vectorization, MLIR (Multi-Level Intermediate Representation) - **Published:** November 16, 2026 - **Apply:** https://www.careerbuilder.com/job-details/vice-president-machine-learning-systems-compiler-engineering-california-md--4c0c9c9f-8f62-4bd9-8637-ddf8371d2088 ## About the Role Machine Learning, Systems Engineering, IR (Infrared), RISC Processors, Artificial Intelligence (AI), ISA Standards, Performance Engineering, Editing, Strategic Planning, Memory Hardware, 15+ years in compiler/systems engineering, including 5+ years leading a compiler team Expert in modern C/C++ and Python on Linux Deep expertise in compiler fundamentals, IRs, and hands-on LLVM/MLIR experience Familiarity with major DL frameworks: PyTorch, TensorFlow, or JAX Strong foundation in data structures, graph algorithms, and optimization techniques Proven ability to build and lead cross-disciplinary engineering teams Strongly Preferred Experience mapping code to GPUs, TPUs, NPUs, or custom AI accelerators Background in instruction selection, register allocation, or SIMD/vectorization Experience with OpenXLA, StableHLO, TVM, or Triton RISC-V depth: privilege levels, RVV extension, LLVM/GCC toolchain, and ABI conventions; ecosystem contributions a plus Track record shipping compiler software to web-scale cloud or embedded environments Familiarity with Bazel/CMake and CI/CD pipelines Experience taking a new platform's compiler from zero to production-ready Leadership Qualities Operates at both strategic and implementation levels: can set compiler architecture direction and contribute directly on critical-path components Track record of building high-performing compiler or systems teams from a small base, including hiring, mentoring, and setting technical culture Strong communicator across technical and business audiences; able to translate compiler performance work into customer-facing throughput, cost, and latency terms High tolerance for greenfield ambiguity: this role requires defining structure and priorities where none currently ## Description Architect and evolve our client's compiler IR strategy, building on MLIR/LLVM infrastructure to lower high- level ML graphs into hardware-aware representations for RISC-V and AI accelerator execution Design and own custom dialects, optimization passes, and lowering pipelines that map cleanly onto ASHAI's vector and accelerator ISA extensions Set the multi-year technical roadmap for the compiler stack, balancing near-term customer performance commitments against long-term platform scalability Graph-Level Optimization & Performance Engineering Drive graph transformations, operator fusion, pattern rewriting, quantization, and memory planning strategies that materially reduce latency and increase throughput on our client's hardware Own performance benchmarking of the compiler stack against GPU baselines: tokens per second, cost per token, and memory efficiency Profile, debug, and tune computational kernels, including matrix multiplication, attention, and other core inference operators, to close the gap between theoretical and achieved performance Toolchain, SDK & Developer Platform Design, build, and maintain a scalable, production-grade compiler toolchain and SDK APIs that customers use to compile and deploy models on our client's hardware Own RISC-V toolchain integration: compiler support, ABI compatibility, and build system tooling for ASHAI- optimized binaries Establish automated testing, benchmarking, and CI/CD infrastructure that keeps the compiler stack stable as it scalesTeam Building & Technical Leadership Recruit, hire, and lead a world-class compiler engineering team from the ground up, setting hiring bar, technical direction, and career growth paths Guide engineers through code review, design review, and mentorship practices that keep the codebase and team execution at a high standard Evaluate and integrate learning-based and agent-assisted approaches into the compilation pipeline and the team's own development practices where they measurably improve outcomes Hardware/Software Co-Design & Cross-Functional Collaboration Partner directly with the SoC Architecture team to align compiler capabilities with the constraints and opportunities of our client's custom silicon, informing ISA extension and microarchitecture decisions Partner with the VP, System & Applications Engineering on the boundary between the compiler stack and the runtime, HAL, and developer SDK, keeping API contracts and framework integration paths coherent end to end Represent the compiler team's perspective in architecture reviews, ensuring compiler and code-generation requirements are first-class inputs to silicon decisions Open-Source Engagement Actively participate in, contribute upstream to, and track major open-source compiler ecosystems relevant to our client's stack, including LLVM, MLIR, OpenXLA/StableHLO, Triton, and TVM Represent our client in the broader ML compiler community, building the company's credibility and visibility