Robotics Data Quality Reviewer

Robotics Data Quality Reviewer is a remote review track for evaluating robotics review outputs against real-world physical-AI constraints. Reviewers grade trajectory choices, perception assumptions, and safety envelopes; flag failure modes; and document the corrected behavior so the modeling team can train on it., * Review robotics review outputs against current safety standards and operating envelopes for Robotics Data Quality Reviewer assignments.

• Grade perception, motion, and decision logic on a structured rubric.
• Flag near-miss and unsafe trajectories with severity tags that match incident taxonomies.
• Capture the corrected behavior or reference trajectory so the modeling team can train on it.
• Adjudicate disputed cases against published standards or firm operating procedures.
• Maintain reviewer-quality scores in inter-rater calibration cycles., * Grade a robotics review model’s chosen trajectory and flag any near-miss or unsafe motion.
• Score a perception output against ground-truth labels and rate the failure category.
• Adjudicate a disputed safety call between two reviewers using firm operating procedures.
• Audit a 25-trajectory batch for rubric consistency and report drift to the program lead.

• Hands-on experience operating, supervising, or evaluating robotic, autonomous, or teleoperated systems for Robotics Data Quality Reviewer work.
• Comfort reasoning about perception, motion planning, and physical safety envelopes.
• Familiarity with structured incident taxonomies and severity scoring.
• Clear written reasoning that names the failure mode and the standard being applied.
• Reliable async availability for at least 10 hours per week., * Background in robotics engineering, autonomy operations, or industrial safety.
• Prior experience reviewing AI-assisted robotics tooling and its failure modes.
• Familiarity with simulation environments and trajectory-replay tooling., * Robotics evaluation
• Perception review
• Motion safety
• Incident taxonomy
• Robotics review
• Robotics and physical AI
• AI evaluation
• Rubric writing
• Expert review

Work model

Remote - US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Hourly rate confirmed after the interview process.

Robotics review systems run in the physical world, where a confident-looking failure can hurt someone. AuraOne uses experienced robotics and operations reviewers to grade outputs against perception, motion, and safety constraints.