> Markdown version of [/jobs/ext/4583274-on-device-ai-ml-systems-engineer](https://www.wearedevelopers.com/jobs/ext/4583274-on-device-ai-ml-systems-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# On-device AI / ML Systems Engineer

- **Company:** ONE STOP COLLECTIBLE CORP
- **Location:** United States (Remote available)
- **Contract:** Permanent contract
- **Skills:** Android Software Development, Android NDK, Artificial Neural Networks, C++ (Programming Language), Python (Programming Language), Performance Tuning, Tensorflow, Large Language Models, ONNX (Open Neural Network Exchange) Format, Model Quantization, Machine Learning Operations, Virtual Agents
- **Published:** November 5, 2026
- **Apply:** https://startup.jobs/ai-phone-on-device-ai-ml-systems-engineer-bjak-my-10677355

## About the Role

* Strong ML systems or inference engineering experience.
 * Experience deploying and optimizing models.
 * Strong Python and C++ skills.
 * Understanding of neural network inference.
 * Experience with model quantization and performance optimization.
 * Understanding of hardware constraints and inference benchmarks.

Nice to have

 * Experience with on-device LLMs.
 * Qualcomm QNN, MediaTek NeuroPilot or similar acceleration frameworks.
 * ONNX Runtime, LiteRT, TensorFlow Lite or ExecuTorch.
 * Android NDK.
 * Mobile or edge AI deployment.
 * Multimodal model optimization.

## Description

* Evaluate suitable open-weight and commercially available models for on-device execution.
 * Benchmark model performance on target mobile hardware.
 * Integrate models into Android applications and system services.
 * Optimize inference latency, memory consumption and power usage.
 * Evaluate quantization, compression and model distillation techniques.
 * Work with CPU, GPU and NPU acceleration.
 * Evaluate local model capabilities for different workflows.
 * Build hybrid local/cloud model routing mechanisms.
 * Identify which tasks can be handled locally and which require cloud inference.
 * Work with AI agent engineers to integrate local models into the agent runtime.