> Markdown version of [/jobs/ext/1973633-staff-software-engineer-ai-engines-3p-tpu-inference](https://www.wearedevelopers.com/jobs/ext/1973633-staff-software-engineer-ai-engines-3p-tpu-inference). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Staff Software Engineer, AI Engines 3P TPU Inference

- **Company:** Google LLC
- **Location:** Mountain View, CA, United States
- **Experience:** Experienced
- **Contract:** Permanent contract
- **Skills:** Artificial Intelligence, Cloud Computing, Software Debugging, Machine Learning, Software Architecture, Software Engineering, Reinforcement Learning, Data Processing, Machine Learning Operations
- **Published:** August 7, 2026
- **Apply:** https://us.experteer.com/career/view-jobs/staff-software-engineer-ai-engines-3p-tpu-inference-mountain-view-ca-usa-58831655

## About the Role

Experteer Overview In this role you will help advance ML infrastructure at scale within Google, shaping how ML systems perform across Cloud and partner products. You will collaborate with Research and cross-functional teams to drive impactful ML capabilities, including compilers and runtimes, and help migrate runtimes and workflows to ML Runtime. You will lead technical direction and deliver scalable software solutions that influence the broader Google AI stack. This is a high-impact, leadership-oriented engineering role at the intersection of ML research and production. Compensation / Benefits * Guide sustainable engineering choices for ML systems at scale * Define next directions for infrastructure over a 12-month horizon * Deliver capability and optimization improvements to Cloud and partner products * Migrate runtimes and custom workflows onto ML Runtime with minimal user disruption * Partner with GDM to transfer innovations into product teams Tasks * Bachelor's degree or aaaaaa
help practical experience * 8 years of software development experience * 5 years testing and launching software products * 3 years in software design and architecture * 5 years of experience with ML-related domains (speech/audio, reinforcement learning, ML infrastructure, or related field) * 5 years experience with ML design and ML infrastructure (model deployment, evaluation, data processing, debugging, fine tuning) Key requirements * bonus target (20%) * equity * health benefits * career growth opportunities * work eligibility sponsorship * remote-friendly policies

## Description

Experteer Overview In this role you will help advance ML infrastructure at scale within Google, shaping how ML systems perform across Cloud and partner products. You will collaborate with Research and cross-functional teams to drive impactful ML capabilities, including compilers and runtimes, and help migrate runtimes and workflows to ML Runtime. You will lead technical direction and deliver scalable software solutions that influence the broader Google AI stack. This is a high-impact, leadership-oriented engineering role at the intersection of ML research and production. Compensation / Benefits * Guide sustainable engineering choices for ML systems at scale * Define next directions for infrastructure over a 12-month horizon * Deliver capability and optimization improvements to Cloud and partner products * Migrate runtimes and custom workflows onto ML Runtime with minimal user disruption * Partner with GDM to transfer innovations into product teams Tasks * Bachelor's degree or equivalent practical experience * 8 years of software development experience * 5 years testing and launching software products * 3 years in software design and architecture * 5 years of experience with ML-related domains (speech/audio, reinforcement learning, ML infrastructure, or related field) * 5 years experience with ML design and ML infrastructure (model deployment, evaluation, data processing, debugging, fine tuning) Key requirements * bonus target (20%) * equity * health benefits * career growth opportunities * work eligibility sponsorship * remote-friendly policies


## Related Videos

- [Green Cloud Computing](https://www.wearedevelopers.com/videos/592-green-cloud-computing)
- [Implementing continuous delivery in a data processing pipeline](https://www.wearedevelopers.com/videos/73-implementing-continuous-delivery-in-a-data-processing-pipeline)
- [Introduction to Azure Machine Learning](https://www.wearedevelopers.com/videos/368-introduction-to-azure-machine-learning)
- [Shipping Faster with Less: Render on Cloud Hosting, AI Workloads, and the Future of DevOps](https://www.wearedevelopers.com/videos/1894-shipping-faster-with-less-render-on-cloud-hosting-ai-workloads-and-the-future-of-devops)
- [WebAssembly: The Next Frontier of Cloud Computing](https://www.wearedevelopers.com/videos/972-webassembly-the-next-frontier-of-cloud-computing)
- [Coffee with Developers - Maria Apazoglou](https://www.wearedevelopers.com/videos/1209-coffee-with-developers-maria-apazoglou)

## Related Articles

- [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud)
- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)
- [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development)
- [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models)
- [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers)
- [Stephan Gillich - Bringing AI Everywhere](https://www.wearedevelopers.com/magazine/489-stephan-gillich-bringing-ai-everywhere)