> Markdown version of [/jobs/ext/2043792-remote](https://www.wearedevelopers.com/jobs/ext/2043792-remote). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Remote

- **Company:** MAG 24 LLC
- **Location:** New York, NY, United States (Remote available)
- **Salary:** $93,600.0
- **Contract:** Permanent contract
- **Skills:** Artificial Intelligence, Language Modeling
- **Published:** August 13, 2026
- **Apply:** https://www.careerjet.com/jobad/us5e8b6a413b7d574f9e95a323c64df154

## About the Role

* Native or near-native fluency in Russian, both spoken and written
 * Professional fluency in English
 * Strong familiarity with contemporary spoken Russian, regional vocabulary, dialects, and informal language
 * Ability to accurately transcribe and analyse Russian-language audio
 * Strong writing, editing, analytical, and critical-thinking skills
 * Excellent attention to linguistic detail and ability to follow detailed guidelines
 * Prior experience with transcription, annotation, localisation, language evaluation, or research workflows is advantageous
 * Background in linguistics, humanities, social sciences, journalism, translation/localisation, or a technical discipline is welcomed
 * Familiarity with AI, language models, or applied research environments is advantageous

## Description

We are sharing a specialised part-time consulting opportunity for Russian-language professionals with strong transcription, editing, analytical, and critical-listening skills to support advanced audio AI research.
This role focuses on transcription, annotation, and evaluation of Russian-language audio and video content for AI training and benchmarking. Selected professionals will assess linguistic accuracy, develop evaluation standards, review model-generated outputs, and help improve the quality of Russian audio AI systems., * Produce accurate written outputs in Russian, with supporting work in English when required

 * Follow detailed transcription, formatting, and annotation guidelines
 * Capture tone, intent, register, regional expressions, dialectal variation, and contemporary language usage
 * Maintain high accuracy and consistency across structured audio datasets

Language & Audio Evaluation

 * Evaluate Russian-language content for linguistic accuracy, fluency, clarity, and naturalness
 * Identify grammatical issues, colloquialisms, regional variations, and linguistic edge cases
 * Assess spoken Russian across general consumer audio contexts
 * Distinguish between formal and informal registers and evaluate context-appropriate language use
 * Provide structured feedback on language and transcription quality

Evaluation Standards & Rubric Development

 * Develop clear evaluation criteria for high-quality Russian-language audio responses
 * Create and refine grading rubrics in Russian and English
 * Document evaluation standards to support consistency across reviewers
 * Identify challenging linguistic cases requiring additional guidance
 * Contribute to the refinement of annotation and evaluation frameworks

AI Model Testing & Quality Assurance

 * Test language-model outputs across Russian audio tasks
 * Evaluate responses for accuracy, completeness, fluency, and instruction adherence
 * Grade model-generated outputs against defined evaluation criteria
 * Participate in quality-assurance and review cycles
 * Identify recurring model errors and provide feedback to improve performance
 * Collaborate with project teams to resolve ambiguities and improve task design


## Related Videos

- [Carl Lapierre - Exploring Advanced Patterns in Retrieval-Augmented Generation](https://www.wearedevelopers.com/videos/1235-carl-lapierre-exploring-advanced-patterns-in-retrieval-augmented-generation)
- [Edit Your Future: Queerverse Radical AI](https://www.wearedevelopers.com/videos/909-edit-your-future-queerverse-radical-ai)
- [Unveiling the Magic: Scaling Large Language Models to Serve Millions](https://www.wearedevelopers.com/videos/1619-unveiling-the-magic-scaling-large-language-models-to-serve-millions)
- [Graphs and RAGs Everywhere... But What Are They? - Andreas Kollegger - Neo4j](https://www.wearedevelopers.com/videos/1311-graphs-and-rags-everywhere-but-what-are-they-andreas-kollegger-neo4j)
- [Building Blocks of RAG: From Understanding to Implementation](https://www.wearedevelopers.com/videos/1249-building-blocks-of-rag-from-understanding-to-implementation)
- [AI is dead, long live AK](https://www.wearedevelopers.com/videos/1093-ai-is-dead-long-live-ak)

## Related Articles

- [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models)
- [Fully Remote Software Engineer Jobs](https://www.wearedevelopers.com/magazine/447-fully-remote-software-engineer-jobs)
- [13 AI Tools You Have to Try](https://www.wearedevelopers.com/magazine/219-13-ai-tools-you-have-to-try)
- [Dev Digest 121 - AI goes offline](https://www.wearedevelopers.com/magazine/456-dev-digest-121-ai-goes-offline)
- [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production)
- [The Best Large Language Models on The Market](https://www.wearedevelopers.com/magazine/319-the-best-large-language-models-on-the-market)