Quality Specialist - Data Annotation
Role details
Job location
Tech stack
Job description
Define and maintain benchmark datasets and gold standards, create training and certification materials, monitor annotator drift, perform double-blind quality audits, and act as a high-trust annotator for critical production labeling. Collaborate with Computer Vision and Data Ops to improve the quality pipeline and scoring models., As a Quality Specialist with Augmodo, you will be a part of a small group of individuals who will collaborate across multiple teams to define our Quality goals.
This role is about setting the quality standard, not just doing production work. You'll be a trusted expert-the person we turn to for tough edge cases and the one who creates the benchmark data others are measured against. You'll work closely with our Computer Vision and Data Operations teams to help improve and and define our quality pipeline
Areas of Focus
- Golden datasets & ground truth: Curate and maintain the critical benchmark datasets with our team, used to certify annotators, score vendors, and measure pipeline drift.
- Certification & training: Create and update training materials and certification tests (measuring precision and speed) required for vendor and annotator onboarding.
- Drift monitoring & scoring: Periodically evaluate annotators against benchmark data to identify drift and help manage QA metrics and scoring models for the Data Ops Hub.
- Quality audits: Conduct rigorous, double-blind quality audits to ensure a gold standard across computer-vision datasets.
- Production labeling: Serve as a high-trust annotator to directly handle production labeling when critical (P0) needs arise.
Requirements
- Experience: 2+ years in data annotation and quality assurance, including reviewing and calibrating other annotators' work.
- Technical Tooling: Experience with Encord or equivalent enterprise annotation platforms (e.g., CVAT, Labelbox, SuperAnnotate); comfort with complex 2D/3D annotation (bounding boxes, polygons, masks).
- Judgment & Attention to Detail: Exceptional ability to spot, track, and adjudicate out-of-stock products and edge cases across large video datasets - and to define a defensible standard for them.
- Communication: Strong verbal and written skills to document standards clearly, justify quality decisions, and collaborate with a global, cross-functional team.
Benefits & conditions
- Ownership: You set the standard the entire labeling operation is measured against - not a cog in the pipeline, but the team that defines it.
- Impact: Help build the world's first passive inventory tracking system for the "Augmented Workforce," and the quality system that lets it scale.
- Innovation: Work at the cutting edge of Spatial AI with a venture-backed startup scaling globally.
- Flexibility: Join a remote-first culture that values transparency, speed, and precision.
Augmodo offers benefits inclusive of medical, dental, vision and 401k
The salary range for this role is $45,000 USD - $65,000 USD +equity
Augmodo is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees regardless of race, color, religion, sex, sexual orientation, gender identity, national origin, veteran, or disability status., Remote or Hybrid United States 117K-158K Annually Senior level 117K-158K Annually Senior level Cloud * Fintech * Software * Business Intelligence * Consulting * Financial Services Lead transaction advisory engagements by performing financial analysis and modeling, evaluating deal structures and valuations, managing multiple projects, liaising with clients and cross-functional teams, preparing clear reports and presentations, and reviewing junior team members' work to ensure accuracy and high-quality deliverables. Top Skills: ExcelFinancial Databases Wipfli
Senior, Transaction Advisory Services
An Hour Ago Remote or Hybrid United States 88K-118K Annually Senior level 88K-118K Annually Senior level Cloud * Fintech * Software * Business Intelligence * Consulting * Financial Services Lead buy- and sell-side Quality of Earnings engagements: analyze financials, assess earnings quality, working capital, and net debt; prepare diligence reports and presentations; manage VDRs; mentor junior staff; support valuation, deal structuring, integration planning, and business development. Top Skills: ExcelFinancial DatabasesVirtual Data Rooms, ServiceNow, 5 Hours Ago Remote or Hybrid 131K-216K Annually Senior level 131K-216K Annually Senior level Artificial Intelligence * Cloud * HR Tech * Information Technology * Productivity * Software * Automation Drive new SaaS license revenue by prospecting and closing enterprise education customers. Build C-suite relationships, lead account and territory planning, orchestrate cross-functional teams, act as trusted advisor on IT and security roadmaps, and bring specialists into deals. Travel up to 50%. Top Skills: AIArmisSaaSServicenowVeza
What you need to know about the Colorado Tech Scene
With a business-friendly climate and research universities like CU Boulder and Colorado State, Colorado has made a name for itself as a startup ecosystem. The state boasts a skilled workforce and high quality of life thanks to its affordable housing, vibrant cultural scene and unparalleled opportunities for outdoor recreation. Colorado is also home to the National Renewable Energy Laboratory, helping cement its status as a hub for renewable energy innovation.
Key Facts About Colorado Tech
- Number of Tech Workers: 260,000; 8.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Lockheed Martin, Century Link, Comcast, BAE Systems, Level 3
- Key Industries: Software, artificial intelligence, aerospace, e-commerce, fintech, healthtech
- Funding Landscape: $4.9 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Access Venture Partners, Ridgeline Ventures, Techstars, Blackhorn Ventures
- Research Centers and Universities: Colorado School of Mines, University of Colorado Boulder, University of Denver, Colorado State University, Mesa Laboratory, Space Science Institute, National Center for Atmospheric Research, National Renewable Energy Laboratory, Gottlieb Institute