Conversational AI Data Annotator

For 30+ years, MARTIN has delivered automotive engineering and manufacturing expertise, supporting innovation across automotive, motorsports, aerospace, defense, and marine industries. Join a team that brings precision, quality, and practical problem-solving to evolving technologies.

What You Will Do

• Review chatbot conversations, individual responses, retrieved content, citations, and related metadata using customer-approved tools.

• Annotate conversational AI data, including text and audio, using approved labeling guidelines, taxonomies, and decision rules.

• Complete required labels, concise rationales, confidence assessments, and ambiguity indicators.

• Evaluate intent recognition, task completion, correctness, completeness, relevance, and overall response quality.

• Check whether responses are supported by available evidence and whether sources are attributed correctly.

• Identify factual errors, unsupported claims, incomplete answers, safety concerns, and policy issues.

• Assign approved failure categories and identify when escalation or specialist review is needed.

• Escalate ambiguous or sensitive cases and situations not covered by existing guidance. Do not create independent standards.

• Participate in onboarding, calibration sessions, refresher training, quality reviews, and adjudication discussions.

• Perform first-level quality checks and correct errors identified during review.

• Maintain accurate annotation records, quality results, exceptions, escalations, and open issues.

• Prepare weekly reports covering completed volume, productivity, quality, backlog, risks, guideline gaps, and required actions.

• Recommend improvements to labeling guidance based on recurring issues. Implement changes only after customer approval.

Artificial Intelligence (AI), Training Data Sets, Artificial Intelligence (AI), Conversation Engine, Detail Oriented, Training Data Sets, Analysis Skills, English Language, Communication Skills, Automotive Engineering, MARTIN Technologies is seeking detail-oriented Conversational AI Data Annotators to help improve chatbot accuracy, reliability, and response quality. You will review text and audio conversations, apply approved evaluation guidelines, and provide clear feedback that helps technical teams understand where responses succeed and where improvements are needed.

This opportunity is ideal for someone who combines analytical thinking, strong English communication, and consistent judgment with the discipline to perform accurate, repeatable reviews., * Experience labeling conversational AI data, including text and audio.

• Professional fluency in English, with strong reading comprehension and written communication.

• Ability to interpret and consistently apply detailed guidelines and decision rules.

• Strong analytical judgment and attention to detail.

• Ability to explain labeling decisions through clear, concise written rationales.

• Consistent accuracy when performing repetitive tasks while meeting quality and turnaround expectations.

• Ability to incorporate feedback and adjust decisions as approved guidelines evolve.

• Experience preparing clear progress and quality reports.

• Bachelor’s degree.

Preferred Experience

• Automotive industry knowledge.

• Experience supporting large-scale conversational AI, technology, or data-annotation programs.

• Master’s degree.

Core Skills

Text and audio annotation * Chatbot evaluation * Guideline interpretation * Evidence and citation review * Written rationales * Quality checks * Issue escalation * Weekly reporting

Work Authorization and Screening

Applicants must currently reside in the United States and be authorized to work in the United States. Visa sponsorship is unavailable now or in the future. Applications from individuals residing outside the United States will not be considered.

Successful completion of required security and background verification is a condition of assignment.