> Markdown version of [/jobs/ext/2025242-software-engineer-on-device-machine-learning](https://www.wearedevelopers.com/jobs/ext/2025242-software-engineer-on-device-machine-learning). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Software Engineer, On-Device Machine Learning

- **Company:** Google LLC
- **Location:** Sunnyvale, CA, United States
- **Experience:** Experienced
- **Contract:** Permanent contract
- **Skills:** Adobe InDesign, Artificial Intelligence, Mobile Application Development, Code Review, Software Debugging, Machine Learning, Performance Tuning, Software Engineering, Data Processing, Hardware Acceleration, Machine Learning Operations, Programming Languages
- **Published:** August 11, 2026
- **Apply:** https://us.experteer.com/career/view-jobs/software-engineer-on-device-machine-learning-sunnyvale-ca-usa-58902027

## About the Role

in representation, runtime, and kernel implementation Tasks * Bachelor's degree or equivalent experience * 5 years of software development experience in one or more programming languages * 3 years of ML infrastructure experience (deployment, evaluation, data processing, debugging) * 2 years of compiler development experience * relevant mobile development experience Key requirements *

## Description

Experteer Overview In this role you will help advance LiteRT, Google's on-device AI framework, enabling high-performance ML on edge devices. You will collaborate with cross-functional teams to design, implement, and optimize on-device ML capabilities for diverse platforms. You'll tackle challenges in model deployment, performance tuning, and cross-platform support, shaping how AI runs efficiently on mobile, desktop, and embedded devices. This position offers a meaningful opportunity to push the boundaries of on-device AI within a fast-moving, innovative environment. Compensation / Benefits * Collaborate in design and code reviews to ensure best practices across technologies * Design and implement ML solutions using ML infrastructure and domain expertise * Develop LiteRT to enable SOTA hardware acceleration on edge devices * Enable on-device deployment of models like Gemini Nano and Gemma across accelerators and platforms * Improve on-device inference performance through optimizations in representation, runtime, and kernel implementation Tasks * Bachelor's degree or equivalent experience * 5 years of software development experience in one or more programming languages * 3 years of ML infrastructure experience (deployment, evaluation, data processing, debugging) * 2 years of compiler development experience * relevant mobile development experience Key requirements *


## Related Videos

- [Implementing continuous delivery in a data processing pipeline](https://www.wearedevelopers.com/videos/73-implementing-continuous-delivery-in-a-data-processing-pipeline)
- [Are Code Reviews Worth It? Insights from 16 Years of Review Data](https://www.wearedevelopers.com/videos/1135-are-code-reviews-worth-it-insights-from-16-years-of-review-data)
- [Future of Mobile AI. What On-Device Intelligence Means for App Developers](https://www.wearedevelopers.com/videos/100264-future-of-mobile-ai-what-on-device-intelligence-means-for-app-developers)
- [Why and when should we consider Stream Processing frameworks in our solutions](https://www.wearedevelopers.com/videos/1085-why-and-when-should-we-consider-stream-processing-frameworks-in-our-solutions)
- [Build a CI/CD pipeline to automate code reviews and ensure code quality](https://www.wearedevelopers.com/videos/349-build-a-ci-cd-pipeline-to-automate-code-reviews-and-ensure-code-quality)
- [Developing an AI.SDK](https://www.wearedevelopers.com/videos/198-developing-an-ai-sdk)

## Related Articles

- [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers)
- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)
- [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market)
- [Dev Digest 121 - AI goes offline](https://www.wearedevelopers.com/magazine/456-dev-digest-121-ai-goes-offline)
- [What Jobs Can You Get with a Software Engineering Degree?](https://www.wearedevelopers.com/magazine/398-what-jobs-can-you-get-with-a-software-engineering-degree)
- [Dev Digest 132 - Binging WADFlix?](https://www.wearedevelopers.com/magazine/473-dev-digest-132-binging-wadflix)