> Markdown version of [/jobs/ext/1986307-remote-data-annotation-jobs-madrid](https://www.wearedevelopers.com/jobs/ext/1986307-remote-data-annotation-jobs-madrid). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Remote Data Annotation Jobs Madrid

- **Company:** Rex Zone
- **Location:** Málaga, Spain (Remote available)
- **Salary:** €62,400.0 - €104,000.0
- **Contract:** Permanent contract
- **Skills:** Training Data, Artificial Intelligence, Computer Vision, Machine Learning, Named Entity Recognition, DataOps, Large Language Models
- **Published:** August 8, 2026
- **Apply:** https://www.buscojobs.com.es/remote-data-annotation-jobs-madrid-en-malaga-ID-366092464

## About the Role

Remote Data Annotation Jobs Madrid (Full-Time, Remote) Join production-grade AI/ML training workflows by labeling and evaluating data used to improve model performance across NLP, computer vision, and content safety systems.
You will follow strict rubrics and maintain strong annotation guidelines compliance to protect training data quality for LLM training pipelines.Key Responsibilities Execute structured annotation tasks: classification, ranking, span labeling, and named entity recognition (NER)Perform LLM evaluation and prompt evaluation (helpfulness, factuality, groundedness, instruction-following)Contribute to RLHF workflows via preference judgments, rationale writing, and comparative response evaluationRun QA evaluation through self-checks, peer reviews, and audit responsesDocument edge cases, track error patterns, and propose guideline clarifications to reduce varianceProjects and Task Types Multilingual NER and text labelingContent safety labeling aligned to policy taxonomiesComputer vision annotation (bounding boxes, segmentation, image-text alignment) as neededCalibration sets and inter-review agreement improvement activitiesRequired Qualifications Experience with guideline-based labeling, evaluation
frameworks, QA, data operations, or similar rubric-driven workAbility to interpret complex guidelines and apply consistent decisions at scaleComfort with web-based annotation tools, task queues, and documentation of edge casesStrong written English for rationale-based RLHF comparisons and clear communicationBenefits Competitive hourly rate: $30-$50/hrFully remote, full-time structured workflows with calibration and quality checkpointsWork on real-world LLM evaluation and multimodal annotation programs#J-*****-Ljbffr

## Description

Remote Data Annotation Jobs Madrid (Full-Time, Remote) Join production-grade AI/ML training workflows by labeling and evaluating data used to improve model performance across NLP, computer vision, and content safety systems.You will follow strict rubrics and maintain strong annotation guidelines compliance to protect training data quality for LLM training pipelines.Key Responsibilities Execute structured annotation tasks: classification, ranking, span labeling, and named entity recognition (NER)Perform LLM evaluation and prompt evaluation (helpfulness, factuality, groundedness, instruction-following)Contribute to RLHF workflows via preference judgments, rationale writing, and comparative response evaluationRun QA evaluation through self-checks, peer reviews, and audit responsesDocument edge cases, track error patterns, and propose guideline clarifications to reduce varianceProjects and Task Types Multilingual NER and text labelingContent safety labeling aligned to policy taxonomiesComputer vision annotation (bounding boxes, segmentation, image-text alignment) as neededCalibration sets and inter-review agreement improvement activitiesRequired Qualifications Experience with guideline-based labeling, evaluation frameworks, QA, data operations, or similar rubric-driven workAbility to interpret complex guidelines and apply consistent decisions at scaleComfort with web-based annotation tools, task queues, and documentation of edge casesStrong written English for rationale-based RLHF comparisons and clear communicationBenefits Competitive hourly rate: $30-$50/hrFully remote, full-time structured workflows with calibration and quality checkpointsWork on real-world LLM evaluation and multimodal annotation programs#J-*****-Ljbffr


## Related Videos

- [Outclassing Frontier LLMs at Extracting Information](https://www.wearedevelopers.com/videos/100303-outclassing-frontier-llms-at-extracting-information)
- [Focoos AI: Building the Future of Computer Vision](https://www.wearedevelopers.com/videos/1659-focoos-ai-building-the-future-of-computer-vision)
- [Fireside Chat: Deep Learning, Deep Impact: Harnessing AI for Language Innovation](https://www.wearedevelopers.com/videos/612-fireside-chat-deep-learning-deep-impact-harnessing-ai-for-language-innovation)
- [Adding knowledge to open-source LLMs](https://www.wearedevelopers.com/videos/1522-adding-knowledge-to-open-source-llms)
- [Computer Vision from the Edge to the Cloud done easy](https://www.wearedevelopers.com/videos/263-computer-vision-from-the-edge-to-the-cloud-done-easy)
- [Exploring 5 Key Applications of AI Abundance with Blockchain Assurance](https://www.wearedevelopers.com/videos/971-exploring-5-key-applications-of-ai-abundance-with-blockchain-assurance)

## Related Articles

- [Fully Remote Software Engineer Jobs](https://www.wearedevelopers.com/magazine/447-fully-remote-software-engineer-jobs)
- [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models)
- [Spanish Business Culture and Etiquette](https://www.wearedevelopers.com/magazine/353-spanish-business-culture-and-etiquette)
- [Best Job Boards for Remote Work for Developers](https://www.wearedevelopers.com/magazine/290-best-job-boards-for-remote-work-for-developers)
- [Dev Digest 121 - AI goes offline](https://www.wearedevelopers.com/magazine/456-dev-digest-121-ai-goes-offline)
- [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk)