Compiler Engineer - Machine Learning Compiler

Mythic Inc.
Palo Alto, United States
1 day ago
Apply on startup.jobs
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
3 years minimum
Working hours
Regular working hours
Job source

Tech stack

Artificial Intelligence C++ (Programming Language) Code Generation Software Debugging Microprocessors Data Flow Control Field-Programmable Gate Array (FPGA) Python (Programming Language) Machine Learning Software Engineering Graphics Processing Unit (GPU) Application Specific Integrated Circuits
+6 more
Pytorch Deep Learning Parallel Computation Backend ONNX (Open Neural Network Exchange) Format C++14

Job description

We’ve raised over $100M from world-class investors including Softbank, Threshold Ventures, Lux Capital, and DCVC, and secured multi-million-dollar customer contracts across multiple markets. About the role Join us in building the next generation of AI compilers. You’ll play a key role in developing the compiler for our novel AI accelerator, working side-by-side with hardware engineers and ML researchers. Your work will shape how deep learning workloads run on cutting-edge dataflow hardware-defining the instruction set, execution model, and developer experience. The result: a compiler that delivers breakthrough performance while remaining seamless and intuitive for ML developers.

Here’s what you will do

  • Contribute across the full compiler stack, including operator lowering, graph/IR transformations, optimization passes, and backend code generation
  • Optimize for dataflow architectures, developing pipelined schedules, memory orchestration, and resource-constrained execution strategies
  • Collaborate with hardware architects to influence architectural features, ensuring the compiler and hardware evolve together
  • Develop compilation strategies that unify our analog compute with digital subsystems
  • Build and maintain a compiler that produces high-performance binaries with strong debugging support, clear error messages, and predictable performance models

Requirements

  • 3+ years of experience building compilers or high-performance systems software, especially those involving complex resource management or optimization.
  • Expert in modern C++ (C++14/17/20) and strong Python.
  • Experience with compiler IRs (SSA-based or graph-based), transformations, and code generation
  • Exposure to specialized accelerators (GPU, NPU, FPGA, or custom ASIC) or parallel architectures The following would be nice to have, but is not required

  • Experience with machine learning compiler stacks (e.g., ONNX, MLIR, TVM, XLA, IREE, PyTorch), with contributions to MLIR or LLVM projects a plus
  • Experience with optimization methods (LP/MIP, CP, SAT/SMT) using solvers like Gurobi or OR-Tools for scheduling and resource allocation
  • Experience compiling for specialized accelerators (GPU, NPU, FPGA, or custom ASIC) on DNN workloads; GPU/DSP experience is valuable if combined with compiler backend work beyond kernel tuning
  • Familiarity with heterogeneous compilation, especially mixing custom accelerators with CPUs/GPUs/NPUs, and exposure to analog or in-memory compute is a plus
  • Experience collaborating in compiler-hardware co-design (architecture + ISA) for better compiler usability and hardware efficiency

Benefits & conditions

  • The opportunity to shape how deep learning and LLM workloads are compiled on novel hardware.
  • A role that spans software and hardware co-design, shaping both the compiler and the accelerator architecture
  • A collaborative, innovative team that values engineering rigor, continuous integration, and user-focused design. We foster an environment of shared learning and technical excellence
  • Competitive compensation, equity, and benefits package At Mythic, we foster a collaborative and respectful environment where people can do their best work. We hire smart, capable individuals, provide the tools and support they need, and trust them to deliver. Our team brings a wide range of experiences and perspectives, which we see as a strength in solving hard problems together. We value professionalism, creativity, and integrity, and strive to make Mythic a place where every employee feels they belong and can contribute meaningfully.

About the company

Mythic is building the future of AI computing with breakthrough analog technology that delivers 100× the performance of traditional digital systems at the same power and cost. This unlocks bigger, more capable models and faster, more responsive applications-whether in edge devices like drones, robotics, and sensors, or in cloud and data center environments. Our technology powers everything from large language models and CNNs to advanced signal processing, and is engineered to operate from -40 °C to +125 °C, making it ideal for industrial, automotive, aerospace, and defense.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on startup.jobs
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:35 min

Preventing remote code execution in PyTorch models

Balázs Kiss · World Congress 2023

1:52 min

Structuring and scaling the backend engineering team

Stefan Lingler Stefan Lingler +1 · Coffee With Developers

1:48 min

Compiling quantum software architectures using machine learning integrations

Matic Petrič Matic Petrič · World Congress 2025

1:06 min

Compiling PyTorch environments for advanced time forecasting

Christoph Lohrmann Christoph Lohrmann +1 · World Congress 2026 Europe

1:12 min

Choosing TypeScript for complex backend applications

Maximilian Otto Maximilian Otto · World Congress 2024

1:42 min

Navigating emerging hardware standardization in vendor programming ecosystems

Paul Graham Paul Graham · LIVE

Videos

See all

Related articles

See all