> Markdown version of [/jobs/ext/2570542-ai-annotation-specialist-fully-remote](https://www.wearedevelopers.com/jobs/ext/2570542-ai-annotation-specialist-fully-remote). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # AI Annotation Specialist - Fully Remote - **Company:** Mercor, Inc. - **Location:** New York, NY, United States (Remote available) - **Salary:** $49,920.0 - $62,400.0 - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Android Software Development, IBM ViaVoice, Virtual Agents - **Published:** August 29, 2026 - **Apply:** https://www.careerjet.com/jobad/us73323dd72c61b3a1782e7812fbc17b84 ## About the Role Must-Have * Native or native-level English, spoken and written. * Clear, precise written English. * An Android phone with a working camera and microphone. * Attention to detail and consistent rubric application. Preferred * Experience in data annotation, linguistic QA, content moderation, or AI model evaluation. * Training in linguistics, translation, or interpreting. * Ability to recognize unnatural or non-native English. ## Description * Review recorded sessions where users interact with an AI assistant via voice and camera. * Compare the assistant's responses to visible video content. Identify hallucinated or fabricated visual details. * Score sessions on visual interpretation, accuracy, relevance, response timing, and spatial language use. * Evaluate if the assistant appropriately warned users about health, safety, or financial risks. * Write detailed comments supporting scores with concrete session evidence. * Capture conversation turns in the intake form., * Complete a short calibration task on sample sessions, assessed on scoring consistency and comment usefulness. Resources & Support * For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome * For any help or support, reach out to: support@mercor.com PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity. ## Related Videos - [Useful AI friends for developers – building a multilingual app](https://www.wearedevelopers.com/videos/622-useful-ai-friends-for-developers-building-a-multilingual-app) - [Edit Your Future: Queerverse Radical AI](https://www.wearedevelopers.com/videos/909-edit-your-future-queerverse-radical-ai) - [Guiding Agentic AI with Vue](https://www.wearedevelopers.com/videos/2033-guiding-agentic-ai-with-vue) - [Angstfreude - AI and Corporate Culture - The Thrill and the Threat](https://www.wearedevelopers.com/videos/100354-angstfreude-ai-and-corporate-culture-the-thrill-and-the-threat) - [AI is dead, long live AK](https://www.wearedevelopers.com/videos/1093-ai-is-dead-long-live-ak) - [Outclassing Frontier LLMs at Extracting Information](https://www.wearedevelopers.com/videos/100303-outclassing-frontier-llms-at-extracting-information) ## Related Articles - [13 AI Tools You Have to Try](https://www.wearedevelopers.com/magazine/219-13-ai-tools-you-have-to-try) - [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models) - [AI & A11Y, Meta's privacy and the future of SEO](https://www.wearedevelopers.com/magazine/599-ai-a11y-meta-s-privacy-and-the-future-of-seo) - [Dev Digest 121 - AI goes offline](https://www.wearedevelopers.com/magazine/456-dev-digest-121-ai-goes-offline) - [Prompt Engineering is a Job of the Past](https://www.wearedevelopers.com/magazine/342-prompt-engineering-is-a-job-of-the-past) - [Dev Digest 137 - AI'm not sure about this](https://www.wearedevelopers.com/magazine/485-dev-digest-137-ai-m-not-sure-about-this)