AI Data Evaluator - Auditing & Compliance Expert

Kintic Ideas
United States
about 2 months ago
Apply on www.indeed.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Part-time (≤ 32 hours)
Experience level
Expert
Experience required
5 years minimum
Compensation
$72,800.0
Working hours
Regular working hours
Job source

Tech stack

Artificial Intelligence Information Systems Fraud Prevention and Detection Performance Monitor

Job description

  • Review domain-specific prompts and AI-generated responses.
  • Evaluate the accuracy, completeness, and logical consistency of intermediate reasoning steps.
  • Validate technical concepts, methodologies, and industry best practices.
  • Identify factual errors, inconsistencies, omissions, or redundant information.
  • Provide structured feedback based on project evaluation guidelines.
  • Ensure high-quality annotations while meeting productivity and quality targets., * Claims review and validation
  • Medical, property, or casualty claims auditing
  • Fraud detection and prevention
  • Claims investigation and documentation
  • Regulatory and policy compliance

Forensic Auditing

  • Financial fraud investigations
  • Forensic accounting
  • Internal investigations
  • Asset tracing
  • Evidence analysis and reporting
  • Litigation support

Insurance Risk

  • Enterprise and operational risk assessment
  • Underwriting principles
  • Risk analysis and mitigation
  • Insurance products and policy interpretation
  • Regulatory compliance
  • Loss prevention strategies

Contract Compliance

  • Contract review and interpretation
  • Vendor and procurement compliance
  • Regulatory and contractual obligations
  • Performance monitoring
  • Compliance auditing
  • Risk identification and remediation

Commercial Disputes

  • Commercial contract disputes
  • Business litigation support
  • Dispute analysis and resolution
  • Arbitration and mediation processes
  • Damages assessment
  • Legal documentation review

Requirements

We are seeking experienced domain experts to support an AI evaluation and data labeling project. The selected professionals will review AI-generated responses related to their area of expertise and evaluate the accuracy, reasoning, and overall quality of the model’s outputs.

This role is ideal for professionals with strong analytical skills and hands-on experience in auditing, insurance, compliance, contract management, or dispute resolution., * Minimum 5+ years of professional experience in one or more of the following domains:

  • Claims Auditing
  • Forensic Auditing
  • Insurance Risk Management
  • Contract Compliance
  • Commercial Disputes
  • Strong analytical and problem-solving skills.
  • Experience reviewing complex reports, audit findings, investigations, compliance documentation, legal or insurance-related documents.
  • Prior experience in quality review, auditing, AI evaluation, annotation, or data labeling projects is highly preferred., Bachelor’s or Master’s degree in one or more of the following:

Accounting/Finance/Commerce/Business Administration/Economics/Insurance/Risk Management/Law (LLB/JD)/Public Administration/Related disciplines

Preferred Certifications

  • Certified Public Accountant (CPA)
  • Chartered Accountant (CA)
  • Certified Internal Auditor (CIA)
  • Certified Fraud Examiner (CFE)
  • Certified Information Systems Auditor (CISA)
  • Certified Risk Manager (CRM)
  • Associate in Risk Management (ARM)
  • Chartered Property Casualty Underwriter (CPCU)
  • Certified Compliance & Ethics Professional (CCEP)
  • Certified Commercial Contracts Manager (CCCM)

Juris Doctor (JD) or equivalent legal qualification (preferred for Commercial Disputes)

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.indeed.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

59 sec

Proving regulatory compliance to auditors and chief officers

Mike Bursell Mike Bursell · World Congress 2026 Europe

1:22 min

Overview of the Sentry error and performance monitoring platform

Priscila Oliveira · World Congress 2023

3:46 min

Core terminology and audiences for interpretable artificial intelligence

Karol Przystalski · LIVE

1:40 min

Addressing data sovereignty and compliance blind spots within AI

Sebastian Kister Sebastian Kister · World Congress 2026 Europe

2:28 min

Preventing sensitive information disclosure in RAG systems

Deepu Deepu · World Congress 2025

1:25 min

Applying compliance frameworks and auditing logic to AI applications

Maish Saidel-Keesing Maish Saidel-Keesing · World Congress 2025

Videos

See all

Related articles

See all