> Markdown version of [/jobs/ext/2028684-staff-software-engineer-ml-compilers-tpu](https://www.wearedevelopers.com/jobs/ext/2028684-staff-software-engineer-ml-compilers-tpu). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Staff Software Engineer, ML Compilers, TPU

- **Company:** Google LLC
- **Location:** New York, NY, United States
- **Experience:** Experienced
- **Contract:** Permanent contract
- **Skills:** Data Analysis, C++ (Programming Language), Compilers, Data Visualization, Software Debugging, Distributed Systems, Python (Programming Language), Machine Learning, Software Architecture, Scientific Computating, AI Infrastructure, Google Cloud, Machine Learning Operations
- **Published:** August 11, 2026
- **Apply:** https://us.experteer.com/career/view-jobs/staff-software-engineer-ml-compilers-tpu-new-york-ny-usa-58902028

## About the Role

Experteer Overview In this role you will contribute to the XLA compiler, enabling TPU workloads and accelerating ML and scientific computing at scale. You will work with cross-functional teams to optimize and extend the compiler stack for new hardware generations, workloads, and models. You'll influence hardware/software co-design and push performance across distributed systems. This is a hands-on role with impact on Google Cloud and internal users, offering opportunities to shape next-gen AI infrastructure. Compensation / Benefits * Develop and optimize compiler passes to extract performance on current and next-gen TPUs * Collaborate with hardware designers on HW/SW co-design for accelerators * Target and compile high-performance ML operations at large scale * Support new workloads, models, and TPU hardware generations * Work across the compiler stack and with end-user ML models to improve efficiency Tasks * Bachelor's degree or equivalent practical experience * 8 years aaaaaaaaaf
_ in C++ or Python * 5 years testing and launching software products * 5 years of experience with performance, large-scale systems data analysis, visualization tools, or debugging * 3 years of software design and architecture Key requirements * bonus target * equity * benefits

## Description

Experteer Overview In this role you will contribute to the XLA compiler, enabling TPU workloads and accelerating ML and scientific computing at scale. You will work with cross-functional teams to optimize and extend the compiler stack for new hardware generations, workloads, and models. You'll influence hardware/software co-design and push performance across distributed systems. This is a hands-on role with impact on Google Cloud and internal users, offering opportunities to shape next-gen AI infrastructure. Compensation / Benefits * Develop and optimize compiler passes to extract performance on current and next-gen TPUs * Collaborate with hardware designers on HW/SW co-design for accelerators * Target and compile high-performance ML operations at large scale * Support new workloads, models, and TPU hardware generations * Work across the compiler stack and with end-user ML models to improve efficiency Tasks * Bachelor's degree or equivalent practical experience * 8 years programming in C++ or Python * 5 years testing and launching software products * 5 years of experience with performance, large-scale systems data analysis, visualization tools, or debugging * 3 years of software design and architecture Key requirements * bonus target * equity * benefits


## Related Videos

- [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail)
- [Just-in-time Compilation in JVM](https://www.wearedevelopers.com/videos/240-just-in-time-compilation-in-jvm)
- [The Cloud is Calling: Answer with In-Demand Skills](https://www.wearedevelopers.com/videos/945-the-cloud-is-calling-answer-with-in-demand-skills)
- [From Model to Metal: An Open Source Stack for Accelerating Intelligence](https://www.wearedevelopers.com/videos/1636-from-model-to-metal-an-open-source-stack-for-accelerating-intelligence)
- [Building a Compiler with C#](https://www.wearedevelopers.com/videos/116-building-a-compiler-with-c)
- [Accelerating Python on GPUs](https://www.wearedevelopers.com/videos/859-accelerating-python-on-gpus)

## Related Articles

- [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers)
- [Dev Digest 121 - AI goes offline](https://www.wearedevelopers.com/magazine/456-dev-digest-121-ai-goes-offline)
- [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models)
- [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud)
- [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development)
- [How Much FAANG Companies Actually Pay Software Engineers in 2025](https://www.wearedevelopers.com/magazine/230-how-much-faang-companies-actually-pay-software-engineers-in-2025)