Remote

MAG 24 LLC
New York, NY, United States
1 day ago
Apply on www.careerjet.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Part-time (≤ 32 hours)
Experience level
Experienced
Experience required
3 years minimum
Compensation
$208,000.0
Working hours
Regular working hours

Tech stack

Artificial Intelligence Data Analysis Machine Learning Prompt Engineering Data Analytics

Job description

We are sharing a specialised part-time consulting opportunity for experienced Data Science, Machine Learning, Applied AI, Statistics, Quantitative Analytics, and Data Analytics professionals to contribute domain expertise to an advanced AI training and evaluation project focused on analytical reasoning, data quality, prompt development, technical communication, and model-output assessment. Selected professionals will review AI-generated analytical content, develop and refine prompts, assess outputs against structured rubrics, conduct research and fact checking, and translate complex findings into clear technical and business-facing conclusions. No prior experience in AI training is required., AI Evaluation & Analytical Review

  • Review AI-generated analytical content for accuracy, clarity, relevance, and logical consistency
  • Evaluate outputs against structured rubrics and professional analytical standards
  • Identify quantitative, factual, or interpretive weaknesses
  • Apply professional judgement to ambiguous or technically complex cases
  • Provide clear written rationales supporting evaluation decisions

Prompt Development, Data & Research

  • Develop and refine prompts for complex data-science and analytical tasks
  • Design scenarios that test quantitative reasoning and data interpretation
  • Interpret datasets, experiments, notebooks, and analytical outputs
  • Conduct independent research and fact checking to validate technical claims
  • Annotate data and identify recurring quality issues across evaluation workflows

Technical Writing & Quality Assurance

  • Produce and review research summaries, analytical reports, experiment findings, and technical documentation
  • Translate quantitative findings for both technical and business audiences
  • Review labelled examples and model outputs for consistency and quality
  • Support calibration across contributors and evaluation standards
  • Collaborate asynchronously with project leads and other domain specialists, Engagement Details
  • Part-time independent contractor engagement
  • Fully remote
  • Compensation: $100-$200/hour
  • Work will involve data-science analysis, AI-output evaluation, prompt development, rubric-based review, data annotation, quality assurance, research, fact checking, and technical writing
  • Assignments may involve research papers, analytical reports, experiment summaries, datasets, notebooks, technical documentation, model outputs, and evaluation rubrics
  • Collaboration will primarily occur asynchronously with project leads and other subject-matter experts
  • Prior experience with prompt engineering, AI evaluation, or RLHF is helpful but not required
  • Project scope, workload, analytical topics, and evaluation standards may evolve depending on project requirements
  • Work must be completed without using confidential or proprietary information belonging to any employer, client, institution, research organisation, or other third party

About the Platform This opportunity is available through 24-MAG LLC. We connect experienced professionals with remote consulting opportunities across technical, evaluation, and project-based workstreams. By submitting this application, you acknowledge that your information may be processed by 24-MAG LLC for recruitment and opportunity matching in accordance with our Privacy Policy

Requirements

  • 3+ years of professional experience in Data Science, Machine Learning, Applied AI, Statistics, Quantitative Analytics, Data Analytics, or a comparable analytical discipline
  • Strong analytical reasoning and quantitative interpretation skills
  • Experience producing or reviewing research papers, analytical reports, experiment summaries, notebooks, or technical documentation
  • Exceptional attention to detail and strong professional writing ability
  • Ability to communicate technical and quantitative concepts clearly
  • Strong independent research and fact-checking skills
  • Experience with data annotation, content review, or rubric-based evaluation is highly desirable
  • Prompt engineering or prompt-authoring experience is advantageous
  • Familiarity with AI-output evaluation, model-quality assessment, or RLHF is beneficial but not required
  • Master’s, MBA, PhD, or another advanced degree is preferred but not required
  • Experience in leading technology companies, research organisations, or similarly rigorous analytical environments is valuable
  • No prior AI-training experience is required

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerjet.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

1:48 min

Automating exploratory data analysis within training pipelines

Dora Petrella · World Congress 2023

1:32 min

Structuring platforms for new services and data analytics

Nevelina Aleksandrova · LIVE

2:36 min

Applying supervised machine learning for practical rule extraction

Katja Träumner

2:14 min

Exploring internal AI product initiatives and global engineering roles

Maria Apazoglou · Coffee With Developers

1:36 min

Performing exploratory data analysis to uncover underlying patterns

Julian Joseph · LIVE

1:31 min

Essential AI and human skills for future teams

Alexander Weißhaupt Alexander Weißhaupt +1 · World Congress 2025

Videos

See all

Related articles

See all