Software Engineer, On-Device Machine Learning

Experteer Overview In this role you will help advance LiteRT, Google’s on-device AI framework, enabling high-performance ML on edge devices. You will collaborate with cross-functional teams to design, implement, and optimize on-device ML capabilities for diverse platforms. You’ll tackle challenges in model deployment, performance tuning, and cross-platform support, shaping how AI runs efficiently on mobile, desktop, and embedded devices. This position offers a meaningful opportunity to push the boundaries of on-device AI within a fast-moving, innovative environment. Compensation / Benefits * Collaborate in design and code reviews to ensure best practices across technologies * Design and implement ML solutions using ML infrastructure and domain expertise * Develop LiteRT to enable SOTA hardware acceleration on edge devices * Enable on-device deployment of models like Gemini Nano and Gemma across accelerators and platforms * Improve on-device inference performance through optimizations in representation, runtime, and kernel implementation Tasks * Bachelor’s degree or equivalent experience * 5 years of software development experience in one or more programming languages * 3 years of ML infrastructure experience (deployment, evaluation, data processing, debugging) * 2 years of compiler development experience * relevant mobile development experience Key requirements *

in representation, runtime, and kernel implementation Tasks * Bachelor’s degree or equivalent experience * 5 years of software development experience in one or more programming languages * 3 years of ML infrastructure experience (deployment, evaluation, data processing, debugging) * 2 years of compiler development experience * relevant mobile development experience Key requirements *