> Markdown version of [/jobs/ext/567589-research-scientist-computer-vision-hand-tracking-manipulation](https://www.wearedevelopers.com/jobs/ext/567589-research-scientist-computer-vision-hand-tracking-manipulation). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Research Scientist - Computer Vision (Hand Tracking & Manipulation) - **Company:** MECKA ASSOC - **Location:** New York, NY, United States - **Salary:** $170,000.0 - $210,000.0 - **Contract:** Permanent contract - **Skills:** Agile Methodology, Artificial Intelligence, Computer Vision, Computer Clusters, Nvidia CUDA, Information Engineering, Distributed Computing Environment, Kinematics, Rapid Prototyping Process, Pytorch, Deep Learning - **Published:** June 17, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=7599a0b4b794378a ## About the Role Do you have experience in Robot vision?, * Deep expertise in Deep Learning, 3D Computer Vision, and specifically Articulated Tracking / Hand Pose Estimation. * Proven experience training large-scale vision models from scratch, not just running inference or fine-tuning existing checkpoints. * Strong theoretical and practical understanding of parametric hand models, inverse kinematics, and dense mesh estimation. * Mastery of PyTorch and deep learning scaling frameworks. * Experience handling and curating massive, multi-terabyte image and video datasets for training. * Comfortable operating in a fast-paced environment where priorities can shift rapidly to capitalize on new research or hardware capabilities., * First-author publications in top-tier venues (CVPR, ICCV, ECCV, NeurIPS) focusing on 3D hand tracking, hand-object interaction (HOI), dexterous manipulation, or human mesh recovery. * Specific experience working with massive egocentric manipulation datasets (e.g., Ego4D, Ego-Exo4D, DexYCB, Epic-Kitchens) and solving the unique optimization challenges they present. * Experience writing custom CUDA kernels to accelerate 3D operations, differentiable rendering of meshes, or collision/contact computation. ## Description While our existing perception division handles state estimation and spatial mapping, this role is dedicated to one of the most critical bottlenecks in embodied AI: dexterous manipulation and human-object interaction. We are hiring a Research Scientist to architect and train proprietary foundation models from scratch focused on 3D hand tracking and articulated pose estimation. Your core mandate is twofold: building our in-house equivalents to cutting-edge 3D hand and mesh recovery architectures, and developing highly robust interaction models tailored for the heavily occluded, chaotic domain of egocentric manipulation. Beyond these core pillars, you will serve as a lead problem-solver for emergent perception challenges as our hardware and downstream robotics needs evolve. To achieve this, we can provide a massive, continuous stream of high-quality, proprietary ground-truth manipulation data captured by our infrastructure. You will use this data advantage to train networks that surpass current public baselines, owning the complete hand-object perception loop for our data engine., * Zero-to-One Model Development: Design, implement, and train state-of-the-art networks for 3D hand pose estimation, dense mesh recovery, and kinematic tracking. * Large-Scale Distributed Training: Scale multi-view and temporal ML architectures across multi-GPU clusters to handle massive, multi-modal datasets of human hands in action. * Loss & Architecture Innovation: Push the boundaries of current paradigms by developing novel loss functions that enforce biomechanical constraints, temporal smoothness, and physical plausibility. Egocentric Hand-Object Interaction (HOI) * Egocentric Manipulation Modeling: Build and train custom architectures capable of handling the extreme motion blur, severe self-occlusion, and rapid rotations inherent in first-person object manipulation. * Dynamic Scene Understanding: Use your models to track objects through complex grasps, segment tools from hands, and map contact points and forces to provide rich regularization for downstream action-conditioned robotics models. Emergent Perception R&D * Rapid Prototyping: Tackle novel, unmapped AI challenges as they arise. You will rapidly prototype and deploy new models for tasks spanning tactile-visual fusion, fine-grained action segmentation, and novel hardware sensor integrations. * Agile Problem Solving: Pivot to resolve sudden algorithmic bottlenecks in the data engine, adapting the latest research to unblock new product capabilities for our robotics customers. ## Related Videos - [How I built my own intelligent Robot Arm from Scratch](https://www.wearedevelopers.com/videos/100097-how-i-built-my-own-intelligent-robot-arm-from-scratch) - [Detect Hand Pose with Vision](https://www.wearedevelopers.com/videos/135-detect-hand-pose-with-vision) - [Photonic Computing: Programming a New Class of AI Accelerators (incl. Live Coding)](https://www.wearedevelopers.com/videos/100196-photonic-computing-programming-a-new-class-of-ai-accelerators-incl-live-coding) - [Coffee with Developers - Stephen Jones - NVIDIA](https://www.wearedevelopers.com/videos/1303-coffee-with-developers-stephen-jones-nvidia) - [Robots Among us: Advances in AI for Everyday Androids](https://www.wearedevelopers.com/videos/100230-robots-among-us-advances-in-ai-for-everyday-androids) - [Robots are coming into the wild! Full-Stack Robotics Engineers, be ready!](https://www.wearedevelopers.com/videos/479-robots-are-coming-into-the-wild-full-stack-robotics-engineers-be-ready) ## Related Articles - [Dev Digest 121 - AI goes offline](https://www.wearedevelopers.com/magazine/456-dev-digest-121-ai-goes-offline) - [Top 6 Hackathons for Developers in 2023](https://www.wearedevelopers.com/magazine/263-top-6-hackathons-for-developers-in-2023) - [What’s in The box? – Unboxing The DeepFace](https://www.wearedevelopers.com/magazine/117-what-s-in-the-box-unboxing-the-deepface) - [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift) - [Dev Digest 112 - The True Crime of AI Development](https://www.wearedevelopers.com/magazine/421-dev-digest-112-the-true-crime-of-ai-development) - [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud)