> Markdown version of [/jobs/ext/1204534-computer-vision-specialist-for-ai-model-evaluation](https://www.wearedevelopers.com/jobs/ext/1204534-computer-vision-specialist-for-ai-model-evaluation). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Computer Vision Specialist for AI Model Evaluation - **Company:** Tri-Lift Industries, Inc. - **Location:** Raleigh, NC, United States (Remote available) - **Salary:** $166,400.0 - $228,800.0 - **Contract:** Temporary contract - **Skills:** Artificial Intelligence, Computer Vision, COBOL (Programming Language), Integrated Development Environments, Python (Programming Language), Mainframes, Object Detection, Open Source Technology, Tensorflow, Pytorch, Deep Learning, Model Validation - **Published:** July 8, 2026 - **Apply:** https://www.careerjet.com/job/register/use9c3a2d56de1b976ebe32c6a6f168c8f ## About the Role * Deep, hands-on experience in computer vision, from applied industry work, research, or a graduate/PhD background in the field. * Working proficiency in Python, applied in research, industry, or open-source work (not theoretical familiarity). * Strong command of modern computer vision methods, including deep learning architectures, evaluation, and standard tooling (e.g., PyTorch/TensorFlow). * Ability to engage reliably for approximately 20 hours per week. * Past experience in AI training, model evaluation, or data annotation is preferred. * Strong written communication and the ability to work independently and manage your own time. ## Description A leading AI lab is building and evaluating frontier models and needs experienced computer vision practitioners to act as ground-truth experts. You will author challenging, real-world vision tasks, generate reference solutions, and evaluate model outputs to surface reasoning and capability gaps in a target model. The work centers on designing robust computer vision problems (e.g., detection, segmentation, recognition, vision-language and multimodal reasoning, or generation), building them out with executable tests where applicable, and then analyzing how models and agents behave against them. All applicants are expected to have working proficiency in Python. This is a part-time W-2 employment position with Cincinnatus LLC, with the opportunity to be placed at a leading AI lab as part of their extended workforce. This role is fully remote within the United States, at approximately 20 hours per week. Key Responsibilities * Task design and development: Design challenging, real-world computer vision problems drawn from your area of expertise (e.g., object detection, segmentation, recognition, multimodal/vision-language reasoning, or image/video generation) that target specific capability gaps in a frontier AI model. * Spec and golden-solution generation: Integrate the problems into an agentic development environment, preparing all necessary components using Python. * Evaluation and analysis: Evaluate the target model''s performance on your tasks. * Headroom identification: Identify tasks where the target model fails, and classify the nature of the failure. * Collaborate with other experts: Work alongside fellow subject-matter experts to keep evaluations consistent and accurate., Description: JOB SUMMARY Duties & Responsibilities: The following responsibilities are subject to change according to workload and changes within the dealership. Additional d… + 4 days ago, Job Summary: The Mainframe Technical Specialist in Raleigh, NC is responsible for analyzing, coding, testing, and modifying legacy mainframe applications. This role involves work… + 1 day ago + Apply easily + ## Related Videos - [Machine learning in the browser with TensorFlowjs](https://www.wearedevelopers.com/videos/155-machine-learning-in-the-browser-with-tensorflowjs) - [Cloud as the new mainframe: why the cloud hype does not reflect the dev reality](https://www.wearedevelopers.com/videos/797-cloud-as-the-new-mainframe-why-the-cloud-hype-does-not-reflect-the-dev-reality) - [Photonic Computing: Programming a New Class of AI Accelerators (incl. Live Coding)](https://www.wearedevelopers.com/videos/100196-photonic-computing-programming-a-new-class-of-ai-accelerators-incl-live-coding) - [How computers learn to see – Applying AI to industry](https://www.wearedevelopers.com/videos/756-how-computers-learn-to-see-applying-ai-to-industry) - [Getting Started with Machine Learning](https://www.wearedevelopers.com/videos/260-getting-started-with-machine-learning) - [Developing an AI.SDK](https://www.wearedevelopers.com/videos/198-developing-an-ai-sdk) ## Related Articles - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [What Industries Outside of AI Are Hiring The Most AI Experts?](https://www.wearedevelopers.com/magazine/98-what-industries-outside-of-ai-are-hiring-the-most-ai-experts) - [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development) - [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models) - [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud) - [The State of WebDev AI 2025 Results: What Can We Learn?](https://www.wearedevelopers.com/magazine/581-the-state-of-webdev-ai-2025-results-what-can-we-learn)