> Markdown version of [/jobs/ext/2309313-on-device-ml-infrastructure-engineer-coreml-runtime-graphics-games-and-machine-learning](https://www.wearedevelopers.com/jobs/ext/2309313-on-device-ml-infrastructure-engineer-coreml-runtime-graphics-games-and-machine-learning). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# On-Device ML Infrastructure Engineer (CoreML Runtime), Graphics, Games and Machine Learning

- **Company:** Apple Inc.
- **Location:** Cupertino, CA, United States
- **Salary:** $150,400.0
- **Contract:** Permanent contract
- **Skills:** Apple Products, C++ (Programming Language), Encodings, Computer Programming, Software Debugging, Python (Programming Language), Machine Learning, Tensorflow, System Software, Pytorch, Parallel Computation, Gpu Programming, Information Technology, ONNX (Open Neural Network Exchange) Format, Machine Learning Operations
- **Published:** August 30, 2026
- **Apply:** https://www.jobmonkeyjobs.com/career/27977311/On-Device-Ml-Infrastructure-Engineer-Coreml-Runtime-Graphics-Games-Machine-Learning-California-Cupertino-7413

## About the Role

We are seeking an ML Infrastructure Engineer with a specific focus on graph compilers and runtimes. If you are a highly motivated software engineer who is creative, versatile, and passionate about machine learning operator primitives, common compiler optimizations, runtimes, and system software engineering in the fast-paced and dynamic field of machine learning, this could be a fantastic role for you., Masters or equivalent experience in Computer Sciences, Engineering, or related subject area.

Highly proficient in C++ or Swift. Familiarity with Python.

Experience with any compiler stack (MLIR/LLVM/TVM/...).

Familiarity with Operating Systems, embedding programming, parallel programming.

Sound understanding of ML fundamentals, including common architectures such as Transformers.

Good communication skills, including ability to communicate with multi-functional audiences.

Preferred Qualifications

Experience with any on-device ML stack, such as TFLite, ONNX, ExecuTorch, etc.

Experience with any ML authoring framework (PyTorch, TensorFlow, JAX, etc.) is a strong plus.

Experience with accelerators, GPU programming is a strong plus.

## Description

We're building an end-to-end developer experience for machine learning development that employs Apple's vertical integration. This allows developers to iterate on model authoring, optimization, transformation, execution, debugging, profiling, and analysis.

This role focuses on the Core ML Runtime for execution on-device. In this role, you will build the world's most advanced ML graph compilation and runtime system, capable of optimizing and delivering ML models efficiently on Apple products and services.

Responsibilities

Architect and maintain the on-device graph compiler, runtime, and kernels for delivering ML operators.

Develop production-critical system software for implementing ML models on Apple Silicon

Proactively identify and resolve functionality gaps.

Optimize model execution for various system objectives like performance, energy efficiency, and thermal management.


## Related Videos

- [Photonic Computing: Programming a New Class of AI Accelerators (incl. Live Coding)](https://www.wearedevelopers.com/videos/100196-photonic-computing-programming-a-new-class-of-ai-accelerators-incl-live-coding)
- [Harnessing Apple Intelligence: Live Coding with Swift for iOS](https://www.wearedevelopers.com/videos/1515-harnessing-apple-intelligence-live-coding-with-swift-for-ios)
- [Machine learning in the browser with TensorFlowjs](https://www.wearedevelopers.com/videos/155-machine-learning-in-the-browser-with-tensorflowjs)
- [A Brief History of Data Storage](https://www.wearedevelopers.com/videos/974-a-brief-history-of-data-storage)
- [From Model to Metal: An Open Source Stack for Accelerating Intelligence](https://www.wearedevelopers.com/videos/1636-from-model-to-metal-an-open-source-stack-for-accelerating-intelligence)
- [Overview of Machine Learning in Python](https://www.wearedevelopers.com/videos/840-overview-of-machine-learning-in-python)

## Related Articles

- [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models)
- [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers)
- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)
- [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development)
- [Dev Digest 118 - not a total recall](https://www.wearedevelopers.com/magazine/452-dev-digest-118-not-a-total-recall)
- [Dev Digest 121 - AI goes offline](https://www.wearedevelopers.com/magazine/456-dev-digest-121-ai-goes-offline)