Vice President, Machine Learning & Systems Compiler Engineering

INTERNATIONAL RECRUITING LLC
United States
2 days ago
Apply on www.careerbuilder.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Working hours
Regular working hours

Tech stack

Application Programming Interfaces (APIs) Artificial Intelligence Computing Platforms Systems Engineering Automation of Tests C++ (Programming Language) CMake Code Review Continuous Integration Data Structures Software Debugging Linux
+14 more
Industry Standard Architecture Python (Programming Language) Machine Learning Open Source Technology Tensorflow Reduced Instruction Set Computing Toolchain Graphics Processing Unit (GPU) Pytorch Optimization Algorithms Machine Learning Operations Api Management Vectorization MLIR (Multi-Level Intermediate Representation)

Job description

Architect and evolve our client’s compiler IR strategy, building on MLIR/LLVM infrastructure to lower high-

level ML graphs into hardware-aware representations for RISC-V and AI accelerator execution

Design and own custom dialects, optimization passes, and lowering pipelines that map cleanly onto ASHAI’s

vector and accelerator ISA extensions

Set the multi-year technical roadmap for the compiler stack, balancing near-term customer performance

commitments against long-term platform scalability

Graph-Level Optimization & Performance Engineering

Drive graph transformations, operator fusion, pattern rewriting, quantization, and memory planning strategies

that materially reduce latency and increase throughput on our client’s hardware

Own performance benchmarking of the compiler stack against GPU baselines: tokens per second, cost per

token, and memory efficiency

Profile, debug, and tune computational kernels, including matrix multiplication, attention, and other core

inference operators, to close the gap between theoretical and achieved performance

Toolchain, SDK & Developer Platform

Design, build, and maintain a scalable, production-grade compiler toolchain and SDK APIs that customers use

to compile and deploy models on our client’s hardware

Own RISC-V toolchain integration: compiler support, ABI compatibility, and build system tooling for ASHAI-

optimized binaries

Establish automated testing, benchmarking, and CI/CD infrastructure that keeps the compiler stack stable as it

scalesTeam Building & Technical Leadership

Recruit, hire, and lead a world-class compiler engineering team from the ground up, setting hiring bar, technical

direction, and career growth paths

Guide engineers through code review, design review, and mentorship practices that keep the codebase and team

execution at a high standard

Evaluate and integrate learning-based and agent-assisted approaches into the compilation pipeline and the

team’s own development practices where they measurably improve outcomes

Hardware/Software Co-Design & Cross-Functional Collaboration

Partner directly with the SoC Architecture team to align compiler capabilities with the constraints and

opportunities of our client’s custom silicon, informing ISA extension and microarchitecture decisions

Partner with the VP, System & Applications Engineering on the boundary between the compiler stack and the

runtime, HAL, and developer SDK, keeping API contracts and framework integration paths coherent end to end

Represent the compiler team’s perspective in architecture reviews, ensuring compiler and code-generation

requirements are first-class inputs to silicon decisions

Open-Source Engagement

Actively participate in, contribute upstream to, and track major open-source compiler ecosystems relevant to

our client’s stack, including LLVM, MLIR, OpenXLA/StableHLO, Triton, and TVM

Represent our client in the broader ML compiler community, building the company’s credibility and visibility

Requirements

Machine Learning, Systems Engineering, IR (Infrared), RISC Processors, Artificial Intelligence (AI), ISA Standards, Performance Engineering, Editing, Strategic Planning, Memory Hardware, 15+ years in compiler/systems engineering, including 5+ years leading a compiler team

Expert in modern C/C++ and Python on Linux

Deep expertise in compiler fundamentals, IRs, and hands-on LLVM/MLIR experience

Familiarity with major DL frameworks: PyTorch, TensorFlow, or JAX

Strong foundation in data structures, graph algorithms, and optimization techniques

Proven ability to build and lead cross-disciplinary engineering teams

Strongly Preferred

Experience mapping code to GPUs, TPUs, NPUs, or custom AI accelerators

Background in instruction selection, register allocation, or SIMD/vectorization

Experience with OpenXLA, StableHLO, TVM, or Triton

RISC-V depth: privilege levels, RVV extension, LLVM/GCC toolchain, and ABI conventions; ecosystem

contributions a plus

Track record shipping compiler software to web-scale cloud or embedded environments

Familiarity with Bazel/CMake and CI/CD pipelines

Experience taking a new platform’s compiler from zero to production-ready

Leadership Qualities

Operates at both strategic and implementation levels: can set compiler architecture direction and contribute

directly on critical-path components

Track record of building high-performing compiler or systems teams from a small base, including hiring,

mentoring, and setting technical culture

Strong communicator across technical and business audiences; able to translate compiler performance work into

customer-facing throughput, cost, and latency terms

High tolerance for greenfield ambiguity: this role requires defining structure and priorities where none currently

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerbuilder.com
Prepare application

Good distractions

Loading talks and stories from around this role…