Computer Vision Specialist for AI Model Evaluation
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
Job description
A leading AI lab is building and evaluating frontier models and needs experienced computer vision practitioners to act as ground-truth experts. You will author challenging, real-world vision tasks, generate reference solutions, and evaluate model outputs to surface reasoning and capability gaps in a target model. The work centers on designing robust computer vision problems (e.g., detection, segmentation, recognition, vision-language and multimodal reasoning, or generation), building them out with executable tests where applicable, and then analyzing how models and agents behave against them. All applicants are expected to have working proficiency in Python. This is a part-time W-2 employment position with Cincinnatus LLC, with the opportunity to be placed at a leading AI lab as part of their extended workforce. This role is fully remote within the United States, at approximately 20 hours per week. Key Responsibilities
- Task design and development: Design challenging, real-world computer vision problems drawn from your area of expertise (e.g., object detection, segmentation, recognition, multimodal/vision-language reasoning, or image/video generation) that target specific capability gaps in a frontier AI model.
- Spec and golden-solution generation: Integrate the problems into an agentic development environment, preparing all necessary components using Python.
- Evaluation and analysis: Evaluate the target model’’s performance on your tasks.
- Headroom identification: Identify tasks where the target model fails, and classify the nature of the failure.
- Collaborate with other experts: Work alongside fellow subject-matter experts to keep evaluations consistent and accurate., Description: JOB SUMMARY Duties & Responsibilities: The following responsibilities are subject to change according to workload and changes within the dealership. Additional d…
- 4 days ago, Job Summary: The Mainframe Technical Specialist in Raleigh, NC is responsible for analyzing, coding, testing, and modifying legacy mainframe applications. This role involves work…
- 1 day ago
- Apply easily +
Requirements
- Deep, hands-on experience in computer vision, from applied industry work, research, or a graduate/PhD background in the field.
- Working proficiency in Python, applied in research, industry, or open-source work (not theoretical familiarity).
- Strong command of modern computer vision methods, including deep learning architectures, evaluation, and standard tooling (e.g., PyTorch/TensorFlow).
- Ability to engage reliably for approximately 20 hours per week.
- Past experience in AI training, model evaluation, or data annotation is preferred.
- Strong written communication and the ability to work independently and manage your own time.
Benefits & conditions
Work Terms This is a part-time W-2 employment position, fully remote within the United States, with an expected commitment of approximately 20 hours per week. Compensation The hourly compensation for this role ranges from $80 to $110. Eligibility Applicants must be legally eligible to work in the United States.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
What Industries Outside of AI Are Hiring The Most AI Experts?
MLOps And AI Driven Development
What Are Large Language Models?
Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud