Data Annotation reviewer (QA) (GenAI/LLM) role

We are seeking a detail-oriented Data Annotation Reviewer (QA) to join our Generative AI team in Louisville, KY. In this role, you will review and validate human-labeled data used to train Large Language Models (LLMs), ensuring annotations meet quality standards and project guidelines. This position is ideal for candidates with experience in AI data services, quality assurance, or data annotation who have a strong eye for detail and excellent communication skills.

Responsibilities

• Review, approve, or reject annotated data based on project guidelines.
• Validate annotation accuracy, completeness, and consistency.
• Evaluate bounding boxes, labels, and AI-generated responses.
• Identify errors, inconsistencies, and quality issues.
• Provide clear, constructive feedback to annotators.
• Conduct quality audits, spot checks, and production reviews.
• Track quality metrics and document findings.
• Collaborate with project managers and cross-functional teams to improve annotation quality.
• Assist in developing quality assurance processes and annotation guidelines.
• Complete end-of-day reporting and maintain project documentation.

• Diploma or equivalent required.
• 2-3 years of experience in Quality Assurance, Data Annotation, AI Data Services, or a related field.
• Experience reviewing data labeling or annotation projects.
• Strong written and verbal English communication skills.
• Excellent attention to detail and analytical thinking.
• Ability to work independently while meeting quality and productivity goals.
• Proficiency with Microsoft Office (Excel, Outlook, and PowerPoint).

Preferred Qualifications

• Bachelor’s degree in Linguistics or a related field.
• Experience with Generative AI, Large Language Models (LLMs), or AI training data.
• Experience creating or reviewing annotation guidelines and training materials.

Requirements

• Must be able to work onsite in Louisville, KY.
• Available to work a minimum of 30 hours per week.
• Willing to complete all required training and certification before project assignment.

If you are passionate about AI, quality assurance, and improving the performance of next-generation language models, we’d love to hear from you. Apply today!

$12 - $13 an hour - Contract