> Markdown version of [/jobs/ext/4570383-aiml-sr-machine-learning-engineer-evaluation](https://www.wearedevelopers.com/jobs/ext/4570383-aiml-sr-machine-learning-engineer-evaluation). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# AIML - Sr Machine Learning Engineer, Evaluation

- **Company:** Apple Inc.
- **Location:** Cupertino, CA, United States
- **Experience:** Expert
- **Salary:** $216,200.0
- **Contract:** Permanent contract
- **Skills:** Artificial Intelligence, Distributed Systems, Python (Programming Language), Machine Learning, Tensorflow, Large Language Models, Prompt Engineering, Model Validation, Agentic-AI, Information Technology, Codebase, Machine Learning Operations, Evaluation of Large Language Models, Artificial Intelligence Markup Language (AIML)
- **Published:** November 4, 2026
- **Apply:** https://www.juju.com/job/7_4CA2B8980110CAA17F4C6AF18E72AB8D

## About the Role

Experience with LLM evaluation, reward modeling, prompt optimization, or agentic systems is highly desirable.Minimum QualificationsStrong background in machine learning and distributed systemsExperience building and maintaining ML infrastructure for evaluation, training, or deploymentAbility to work effectively across multiple codebases, teams, and organizations8+ years of professional experience as a software engineer, preferably in machine learning or a related fieldBachelor's or Master's degree in Computer Science or a related fieldPreferred QualificationsExperience with LLM evaluation, LLM-as-judge, or reward modelingExperience with prompt optimization, agent harness development, or post-training (SFT, DPO, RLHF)Proficiency in Python and ML frameworks such as PyTorchExperience with agentic systems, simulation environments, or trajectory-based data generationFamiliarity with on-device or privacy-preserving MLProactive and determined problem-solving skillsExcellent communication

## Description

Role Number: 200668113Team: Machine Learning and AILocation: CupertinoPosted: 2026-06-11SummaryWe are seeking a highly skilled and experienced machine learning engineer to join AIML Evaluation to build the systems that evaluate and refine Apple's foundation models and agents.
As a key member of the team, you will help design and develop benchmarks, evaluators, simulation environments, and prompt and context optimization pipelines that drive quality improvements across Apple's AI experiences.You will collaborate with product teams and the foundation model team to close the loop between observation and improvement, contributing datasets, environments, and reward signals that drive model and agent quality.DescriptionOur team builds the benchmarks, environments, and tooling that power model and agent refinement, and turns observations into actionable opportunities for the next model and agent iteration.
We work across the full spectrum of evaluation: offline benchmarks, device-in-the-loop simulation, and on-device observation in production.
We develop LLM-as-judge evaluators, train reward models calibrated against human feedback, optimize prompts and context for agents, and contribute targeted datasets and reward signals to foundation model post-training.In this role, you will play a crucial role in designing and developing evaluation and refinement infrastructure that supports a broad range of AI products at Apple.You will work on agent and model evaluation across offline, device-in-the-loop, and on-device settings; build automated prompt and context optimization pipelines; and partner with product and research teams to translate failure analysis into measurable model and agent improvements.You will also have the opportunity to engage with product teams across Apple and contribute to advancements in large language models and agentic systems that will reach millions of users.To succeed in this role, you should have a strong background in machine learning systems, distributed infrastructure, and a proven track record of
building and maintaining ML evaluation or training infrastructure.You should be a proactive problem solver with excellent communication skills and the ability to work effectively across multiple codebases, teams, and organizations.