Data Evaluation Specialist (US Remote)
Role details
Job location
Tech stack
Job description
Clearstone Analytics is seeking a sharp, analytical Data Evaluation Specialist to join our elite "Human-in-the-Loop" (HITL) team. In this role, you will go beyond simple proofreading to perform Reinforcement Learning from Human Feedback (RLHF) and logic evaluation for the next generation of Large Language Models (LLMs). You will be responsible for reviewing, ranking, and refining AI-generated content to ensure it meets strict standards for accuracy, safety, and human-like reasoning. This is a high-impact, fully remote position for US-based professionals who value precision and want to be at the forefront of AI data sovereignty., * Model Alignment & RLHF: Evaluate and rank multiple AI-generated responses based on nuance, tone, and logical consistency to improve model performance.
- Logic Evaluation: Conduct deep-dive reviews of technical data and complex reasoning tasks to ensure model outputs align with real-world facts.
- Precision Editing: Proofread and verify data entries for grammatical accuracy and adherence to project-specific style guides (AP, Chicago, or custom enterprise standards).
- Fact-Checking: Perform meticulous research to verify information accuracy against credible secondary sources.
- Security Compliance: Adhere to strict data sovereignty protocols, including encrypted workspace management and multi-factor authentication (MFA).
Requirements
Do you have experience in Technical Proficiency?, * Location: Must be a legal US resident (verified via biometric KYC).
- Education/Experience: Proven background in technical writing, journalism, copy editing, or data analysis.
- Analytical Mindset: Ability to follow complex, evolving annotation guidelines and apply subjective judgment with high consistency.
- Style Proficiency: Command of AP Style and the Chicago Manual of Style for high-fidelity content review.
- Technical Literacy: Proficiency in Google Workspace, Slack, and cloud-based data management tools.
- Communication: Exceptional written English skills with a focus on articulating "why" a specific logic path was chosen.
Benefits & conditions
$10 - $60 an hour - Temporary, Contract, Pulled from the full job description
- Flexible schedule, At Clearstone, we don't do "micro-tasks". We focus on high-fidelity projects that require real human expertise.
- Competitive Pay: Rates that reflect the specialized nature of your analytical work.
- Secure Infrastructure: Work with a team that prioritizes data integrity and professional security standards.
- Remote Flexibility: 100% remote work with a streamlined weekly payout system.
Pay: $10.00 - $60.00 per hour
Benefits:
- Flexible schedule