> Markdown version of [/jobs/ext/1906321-software-principal-engineer-ai-compiler](https://www.wearedevelopers.com/jobs/ext/1906321-software-principal-engineer-ai-compiler). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Software Principal Engineer- AI Compiler

- **Company:** Ampere Computing
- **Location:** Santa Clara, United States
- **Salary:** $195,000.0
- **Contract:** Permanent contract
- **Skills:** Artificial Intelligence, Artificial Neural Networks, C++ (Programming Language), Data Structures, Python (Programming Language), Pattern Recognition, Pytorch, Deep Learning, Information Technology, Hardware Acceleration
- **Published:** August 3, 2026
- **Apply:** https://www.dice.com/job-detail/606c10c0-68d9-4a63-b94d-5e759198bdf5

## About the Role

* Bachelors degree in Computer Science, Mathematics or a related technical field & 8 years of related experience; or Master's degree & 6 years
 * Strong CS fundamentals: algorithms, data structures, systems
 * Solid graph algorithm knowledge and reasoning ability
 * Proficiency in Python and C/C++
 * Demonstrated exceptional problem-solving ability - IOI medal, ACM ICPC medal, Codeforces Grandmaster, USACO Platinum, or equivalent competitive programming achievement is a big plus
 * Preferred to have traditional CPU or GPU compiler development background
 * Familiar with LLVM compiler framework as well as MLIR dialects is a plus
 * Fast learner who can pick up new domains quickly and maximize agent-assisted development
 * Familiarity with deep learning concepts and neural network architectures is a plus

## Description

In this role, you will optimize computational graphs to unlock the full potential of Ampere's deep learning accelerator. You'll work across the full SW/HW stack - from inference serving and framework integration down to compiler, runtime, and compute kernels.

What You'll Achieve:

 * Optimize deep learning computational graphs for performance, throughput, and latency on Ampere's accelerator hardware
 * Enable popular models and frameworks (PyTorch, Llama.cpp) and serving platforms (vLLM, SGLang)
 * Identify and implement graph-level optimizations: op fusion, pattern recognition, redundancy elimination
 * Collaborate on HW/SW co-design to push computational efficiency
 * Work with cross-functional teams to integrate AI solutions into Ampere's AI hardware platforms


## Related Videos

- [Getting Started with Machine Learning](https://www.wearedevelopers.com/videos/260-getting-started-with-machine-learning)
- [Photonic Computing: Programming a New Class of AI Accelerators (incl. Live Coding)](https://www.wearedevelopers.com/videos/100196-photonic-computing-programming-a-new-class-of-ai-accelerators-incl-live-coding)
- [Phel, a native Lisp for PHP](https://www.wearedevelopers.com/videos/791-phel-a-native-lisp-for-php)
- [The AI-Native Engineering Org: What’s Real, What’s Hype, What’s Next](https://www.wearedevelopers.com/videos/100004-the-ai-native-engineering-org-what-s-real-what-s-hype-what-s-next)
- [Geometric deep learning for drug discovery](https://www.wearedevelopers.com/videos/264-geometric-deep-learning-for-drug-discovery)
- [From Model to Metal: An Open Source Stack for Accelerating Intelligence](https://www.wearedevelopers.com/videos/1636-from-model-to-metal-an-open-source-stack-for-accelerating-intelligence)

## Related Articles

- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)
- [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development)
- [Stephan Gillich - Bringing AI Everywhere](https://www.wearedevelopers.com/magazine/489-stephan-gillich-bringing-ai-everywhere)
- [What is Agentic Programming and Why Should Developers Care?](https://www.wearedevelopers.com/magazine/625-what-is-agentic-programming-and-why-should-developers-care)
- [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models)
- [Transforming Software Development: The Role of AI and Developer Tools](https://www.wearedevelopers.com/magazine/527-transforming-software-development-the-role-of-ai-and-developer-tools)