> Markdown version of [/jobs/ext/2281513-remote-domain-expert-reviewer-music](https://www.wearedevelopers.com/jobs/ext/2281513-remote-domain-expert-reviewer-music). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Remote Domain Expert Reviewer - Music - **Company:** Cornerstone Barricades - **Location:** San Francisco, CA, United States - **Experience:** Experienced - **Salary:** $83,200.0 - $104,000.0 - **Contract:** Contract - **Skills:** Artificial Intelligence, Large Language Models, Prompt Engineering - **Published:** August 28, 2026 - **Apply:** https://turing.betterteam.com/remote-domain-expert-reviewer-music-3/apply ## About the Role * Master's degree or higher in any field; degrees in Music, Music Theory, Musicology, Ethnomusicology, Music Education, Music Production, Audio Engineering, Performing Arts, or other music-related disciplines are preferred. * Strong knowledge of music, including music theory, composition, genres, composers, artists, instruments, music history, production techniques, notation, and contemporary music trends. * 3+ years of relevant professional experience, preferably in music education, performance, composition, music production, journalism, research, content creation, audio engineering, or a related field. * Excellent written English, research, and analytical skills. * Strong attention to detail and ability to evaluate music-related information accurately, identify factual inconsistencies, and assess reasoning across diverse musical topics., * Experience reviewing AI-generated content, LLM evaluations, prompt engineering, or annotation quality. * Familiarity with quality assurance, editorial review, or content evaluation workflows. * Strong knowledge of music theory, genres, composers, artists, instruments, music production, and music history. * Ability to provide objective, evidence-based feedback while maintaining consistent quality standards. * Experience working independently in a fast-paced, quality-focused environment. ## Description We are seeking a highly qualified Music Domain Reviewer to support the quality assurance of Large Language Model (LLM) evaluation projects. In this role, you will review domain-specific prompts, evaluate completed tasks for accuracy and quality, ensure adherence to project guidelines, and provide actionable feedback to maintain high annotation standards. Your expertise in music will help ensure the reliability, consistency, and quality of AI evaluation data across diverse music-related topics., * Review and validate domain-specific prompts covering music theory, genres, composers, artists, music history, production, instruments, and related topics. * Evaluate completed tasks to ensure factual accuracy, reasoning quality, completeness, and compliance with project guidelines. * Identify factual inaccuracies, logical inconsistencies, hallucinations, outdated information, and low-quality annotations. * Ensure prompts are challenging, relevant, and aligned with project objectives. * Provide clear, constructive, and evidence-based feedback to contributors to improve task quality. * Maintain consistency across reviews by following established quality standards and review guidelines. * Escalate ambiguous or complex cases when necessary and document review findings. * Collaborate with project managers and AI teams to continuously improve evaluation quality and review processes. ## Related Videos - [Teaching an LLM to review code … like a Senior Engineer!](https://www.wearedevelopers.com/videos/100324-teaching-an-llm-to-review-code-like-a-senior-engineer) - [Creating Industry ready solutions with LLM Models](https://www.wearedevelopers.com/videos/899-creating-industry-ready-solutions-with-llm-models) - [Edit Your Future: Queerverse Radical AI](https://www.wearedevelopers.com/videos/909-edit-your-future-queerverse-radical-ai) - [Same Words, Different Worlds: Who's in Control?](https://www.wearedevelopers.com/videos/2071-same-words-different-worlds-who-s-in-control) - [Bringing the power of AI to your application.](https://www.wearedevelopers.com/videos/1010-bringing-the-power-of-ai-to-your-application) - [AI is dead, long live AK](https://www.wearedevelopers.com/videos/1093-ai-is-dead-long-live-ak) ## Related Articles - [Dev Digest 121 - AI goes offline](https://www.wearedevelopers.com/magazine/456-dev-digest-121-ai-goes-offline) - [Dev Digest 137 - AI'm not sure about this](https://www.wearedevelopers.com/magazine/485-dev-digest-137-ai-m-not-sure-about-this) - [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models) - [Dev Digest 138 - Are you secure about this?](https://www.wearedevelopers.com/magazine/486-dev-digest-138-are-you-secure-about-this) - [13 AI Tools You Have to Try](https://www.wearedevelopers.com/magazine/219-13-ai-tools-you-have-to-try) - [How to Tell if Something Was Written by ChatGPT](https://www.wearedevelopers.com/magazine/314-how-to-tell-if-something-was-written-by-chatgpt)