Data Annotation Lead
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
Job description
We’re looking for a Data Annotation Lead to own our annotation operation end-to-end and build the team behind it. This is a lead / player-coach role with a heavy PM lean: you’ll set the framework, quality bar, and tooling for annotation, turn ambiguous research requests into crisp guidelines, and scale a workforce that can pivot fast without dropping quality. You’ll sit at the seam of ML/CV, product, and operations.
What you’ll do
- Own annotation operations end-to-end - quality, throughput, and cost per delivered hour
- Build and lead the in-house annotation team; own the in-house vs. partner/BPO mix and manage external vendors where used
- Translate research and client requirements into clear annotation guidelines, taxonomies, and QA rubrics
- Stand up the quality system: audits, inter-annotator agreement, golden sets, reviewer scorecards, escalation paths
- Partner with ML/CV and product to spec and pilot new annotation task types for fast-moving experiments
- Drive AI-assisted labeling (model pre-labels * human correction) to raise throughput and cut cost
- Own the metrics - dashboards on quality and volume - and report the state of annotation to leadership
- Stay in the weeds: annotate yourself whenever a new task type is being designed
Requirements
- Direct experience in data annotation / labeling (required - the thing we care most about)
- Ideal background in data collection, physical AI / robotics, or text annotation
- Proven people and operations leadership - you’ve built or scaled a team or function
- PM instincts: ruthless prioritization of competing requests, organized execution under ambiguity, strong stakeholder management across annotators, engineering, and clients
- Clear written and verbal communication - your guidelines are the source of truth for the team
- Comfort with annotation tooling and the ability to leverage AI coding tools to build internal trackers/dashboards (no formal CS background required)
- Intermediate understanding of ML and how annotation quality drives model performance
- A level of hardcore-ness while still treating people like people
Nice to have
- Previously led a data annotation team, or were a top-tier annotator yourself
- Vendor / BPO management experience, ideally where quality was the primary lever
- Familiarity with text annotation styles and video concepts (frame rate, keypoints, bounding boxes, temporal segments)
- Experience managing distributed or offshore teams
Benefits & conditions
Remote Easy Apply 153K-213K Annually Senior level 153K-213K Annually Senior level Big Data * Fintech * Mobile * Payments * Financial Services Lead product strategy for Affirm’s 1:Many distribution partnerships, owning partner portfolio and building repeatable integration capabilities. Define roadmaps, prioritize features, develop success metrics/OKRs, and partner with commercial, design, analytics, and engineering to launch and scale platform partner integrations that drive merchant growth. Top Skills: Figma, Toast, Remote or Hybrid Easy Apply 220K-259K Annually Senior level 220K-259K Annually Senior level Artificial Intelligence * Cloud * Computer Vision * Hardware * Internet of Things * Software The role involves helping modernize industries through IoT solutions, engaging with clients, managing implementations, and driving tech adoption. Significant pre-sales experience is required, coupled with a strong technical background in hardware and cloud applications. Top Skills: AIAutomationBashCloud SoftwareComputer NetworkingControl SystemsIotJavaScriptOpen ApiPython
What you need to know about the Colorado Tech Scene
With a business-friendly climate and research universities like CU Boulder and Colorado State, Colorado has made a name for itself as a startup ecosystem. The state boasts a skilled workforce and high quality of life thanks to its affordable housing, vibrant cultural scene and unparalleled opportunities for outdoor recreation. Colorado is also home to the National Renewable Energy Laboratory, helping cement its status as a hub for renewable energy innovation.
Key Facts About Colorado Tech
- Number of Tech Workers: 260,000; 8.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Lockheed Martin, Century Link, Comcast, BAE Systems, Level 3
- Key Industries: Software, artificial intelligence, aerospace, e-commerce, fintech, healthtech
- Funding Landscape: $4.9 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Access Venture Partners, Ridgeline Ventures, Techstars, Blackhorn Ventures
- Research Centers and Universities: Colorado School of Mines, University of Colorado Boulder, University of Denver, Colorado State University, Mesa Laboratory, Space Science Institute, National Center for Atmospheric Research, National Renewable Energy Laboratory, Gottlieb Institute
About the company
Mecka AI is building the data infrastructure layer for robotics and embodied AI. We design and operate global systems for data capture, data labeling, and hardware-enabled workflows used by leading AI and robotics teams. Our operations span multiple countries, with contributors, partners, and customers across North America and Asia. Our Mission
Robotics will become the largest industry in human history - larger than anything that has come before it. As intelligent machines move into the physical world, they will dramatically expand global GDP, raise the material standard of living for everyone, and ultimately help make humanity a multiplanetary civilization. None of that happens without one thing: enormous amounts of high-quality, real-world data.
Mecka AI builds that foundation. We are the data infrastructure layer for robotics and embodied AI - the substrate that teaches machines to perceive, reason, and act in reality. Get this right, and we accelerate the most important technological transition of our time.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.builtincolorado.comGood distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
MLOps And AI Driven Development
Navigating the AI Shift
Graph and AI Trends 2026: Why Is AI Running but Not Yet Delivering?
Dev Digest 132 - Binging WADFlix?