AI Training Data Annotation Consultant (Real...

US Tech Solutions, Inc.
Seattle, WA, United States
2 months ago

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Compensation
$79,040.0 - $83,200.0
Working hours
Regular working hours
Languages
English
Job source

Tech stack

Geographic Information Systems Artificial Intelligence Data Validation Machine Learning Data Classification Large Language Models GPT

Job description

  • Support annotation & QA for AI-driven home valuation. You’ll establish data standards that train and evaluate the LLMs powering home value algorithm. We’ll teach you real estate market knowledge; you bring strong annotation discipline and AI literacy., + Establish & enforce annotation standards for real estate datasets (neighborhoods, market conditions, property signals)

  • Review annotated work for accuracy & consistency; identify systemic errors and coach team on corrections

  • Evaluate how LLM outputs compared to human judgment; flag where models miss important nuances

  • Research unfamiliar neighborhoods using structured methodology; develop domain expertise over time

  • Spot & escalate data quality issues that would degrade valuation accuracy

  • Integrate LLMs into your workflows to accelerate research and improve annotation efficiency.

Requirements

  • Annotation/QA discipline: Prior experience with labeling, tagging, categorizing, or data classification work (professional or informal). Comfort with structured rules and consistency standards.

  • AI tool literacy: Hands-on experience with LLMs (ChatGPT, Claude, Gemini, etc.). Ability to identify when AI outputs are wrong, confusing, or incomplete.

  • Attention to detail & rule-following: Demonstrated ability to work within strict guidelines, apply rules consistently, and flag edge cases rather than guess.

  • Feedback receptiveness: Openness to critical feedback on your work; ability to iterate and improve based on coaching.

Skillsets:

  • Prior real estate industry experience (agent, appraiser, analyst, investor)

  • Data validation or quality assurance background

  • Experience evaluating AI/ML model outputs

  • Familiarity with structured research methodologies

  • Background in geographic information systems (GIS) or spatial analysis

Education:

  • Bachelor’s degree in English, Linguistics or a related field.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on juju.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:53 min

Enhancing data validation and self-service analytics with AI

Kateřina Ščavnická Kateřina Ščavnická · WWC 2025

40 sec

Generative pre-trained transformer models powering code completions

lgonta lgonta +1 · WWC 2024

7:25 min

Request data validation using Fluent JSON Schema

Matteo Collina Matteo Collina · JS Congress

2:36 min

Applying supervised machine learning for practical rule extraction

Katja Träumner

1:31 min

Essential AI and human skills for future teams

Alexander Weißhaupt Alexander Weißhaupt +1 · WWC 2025

51 sec

Assessing GPT-4o performance for pull request feedback

Merrill Lutsky Merrill Lutsky · WWC 2025

Videos

See all

Related articles

See all