Computer and Information Systems Managers

Computer and Information Systems Managers is a remote review track for evaluating AI outputs across computer and information systems managers specialist operations workflows. Reviewers grade workflow correctness, policy adherence, and stakeholder fit; flag operational risk; and document the right next step so the modeling team can train on it., * Review AI outputs against current computer and information systems managers specialist operations workflows, playbooks, and firm policy for Computer and Information Systems Managers assignments.

• Grade tone, escalation logic, and stakeholder fit on a structured rubric.
• Flag operational risk, missed escalations, and policy-adherence gaps with severity tags.
• Capture the right next step so the modeling team can train on it.
• Adjudicate disputed treatments against published playbooks or firm guidance.
• Maintain reviewer-quality scores in inter-rater calibration cycles., * Grade a model’s response to a real computer and information systems managers specialist operations ticket and rate workflow, tone, and escalation.
• Flag a missed escalation with the right severity tag and corrected next step.
• Adjudicate a disputed playbook call between two reviewers using firm guidance.
• Audit a 25-row batch for rubric consistency and report drift to the program lead.

• Direct working experience in computer and information systems managers specialist operations on real teams for Computer and Information Systems Managers work.
• Comfort applying multi-page rubrics consistently across long batches.
• Clear written reasoning that names the policy or workflow being applied.
• Strong attention to detail and the ability to flag when a prompt itself is the problem.
• Reliable async availability for at least 10 hours per week., * Prior experience training, calibrating, or QA-ing operations teams.
• Familiarity with AI-assisted workflow tooling and its failure modes.
• Bilingual experience for cross-region operations.

Skills

• Operational review
• Policy adherence
• Workflow judgment
• Stakeholder communication
• Computer and Information Systems Managers specialist operations
• Active Listening
• Adaptability
• Complex Problem Solving
• Coordination
• Data base management
• English Language
• Making Decisions and Solving Problems

Work model

Remote - US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Hourly rate confirmed after the interview process.