What's the current gold standard dataset for training grasp policies?

End effectors, dexterous hands, tendon drives, tactile fingertips, grasp planning, and teleoperation.
young58
Posts: 106
Joined: Fri Oct 17, 2025 6:16 am

What's the current gold standard dataset for training grasp policies?

Post by young58 »

Genuinely split on this one, wanted outside opinions. Tendon-driven fingers let you move the heavier actuators back into the palm or forearm, keeping the fingers themselves light and fast, but they introduce cable routing, tensioning, and long-term wear problems that direct-actuated fingers don't have. Payload-to-hand-weight ratio varies a lot across current dexterous hands, and it's a meaningful tradeoff - more DoF and finer sensing generally means more actuators and mass in the hand itself, which eats into the arm's usable payload budget. Object occlusion by the robot's own hand during the final approach to a grasp is a common and annoying perception problem - the closer the hand gets to a good grasp position, the more it blocks the camera's view of exactly what it's about to grab. Happy to be told I'm wrong on any of this.
they/them
olga_lind
Posts: 170
Joined: Tue Dec 24, 2024 12:11 pm

Re: What's the current gold standard dataset for training grasp policies?

Post by olga_lind »

@young58 One nitpick - Compliant wrists that absorb impact during a bad approach or misjudged contact reduce mechanical stress on the whole arm, which matters a lot for long-term reliability even though it's a less visible feature than the hand itself.
servosan90
Posts: 56
Joined: Mon Feb 16, 2026 7:41 am

Re: What's the current gold standard dataset for training grasp policies?

Post by servosan90 »

I'd push back on this a bit. Figure's fourth-generation Dexterous Hand (on Figure 02/03) reportedly offers 16 degrees of freedom per hand with sensors integrated into each finger, aimed at fine force control tasks like handling small electronic components without crushing them.
he/him
novikova63
Posts: 63
Joined: Sun Jan 25, 2026 8:26 pm

Re: What's the current gold standard dataset for training grasp policies?

Post by novikova63 »

@servosan90 I'd frame this differently. Cable routing through a wrist joint with multiple degrees of freedom is a genuinely tricky mechanical design problem - tendons and wiring both need enough slack to avoid binding through the full range of motion without tangling or fraying over thousands of cycles.
carol38
Posts: 80
Joined: Thu Aug 28, 2025 1:48 am

Re: What's the current gold standard dataset for training grasp policies?

Post by carol38 »

Not to derail, but this reminds me of something adjacent: Bimanual manipulation - two arms coordinating on one task - is harder than it looks mostly because of the added degrees of freedom and the timing/force coordination required; a lot of 'two-handed' demos are actually closer to two independent single-hand tasks done in sequence.
servosan90
Posts: 56
Joined: Mon Feb 16, 2026 7:41 am

Re: What's the current gold standard dataset for training grasp policies?

Post by servosan90 »

Still learning the space, so correct me if wrong - Wet, oily, or otherwise low-friction objects are still a genuine edge case for most current hands, since tactile sensing and grasp-force controllers are typically tuned and validated on dry, higher-friction test objects. Totally unrelated but has anyone else noticed how fast component costs are dropping this year.
he/him
karen_kim
Posts: 116
Joined: Wed Jun 25, 2025 11:18 pm

Re: What's the current gold standard dataset for training grasp policies?

Post by karen_kim »

Small correction on one detail: Grasp planning for deformable or non-rigid objects (bags, cables, cloth) remains one of the genuinely unsolved problems in manipulation - rigid-body grasp models simply don't capture how the object will behave once contact starts. Kind of makes me think about how different this all looked even three years ago.
ethan.lewis5
Posts: 65
Joined: Sat Apr 04, 2026 7:35 pm

Re: What's the current gold standard dataset for training grasp policies?

Post by ethan.lewis5 »

Thanks for laying this out, genuinely useful. A lot of the manipulation shown in production demos still leans heavily on teleoperation, particularly for anything involving fine force control or novel objects - autonomous grasp success rates on genuinely unstructured, previously-unseen clutter are still well below what teleoperation can achieve. Palm sensing gets less attention than fingertip sensing, but a lot of power grasps (holding a box, a tool handle) rely more on palm and lateral finger contact than fingertip contact, so under-sensing the palm can leave a real blind spot in grasp confidence.
Opinions my own, not my employer's.
zoeanderson
Posts: 243
Joined: Sat Oct 26, 2024 2:39 am

Re: What's the current gold standard dataset for training grasp policies?

Post by zoeanderson »

@ethan.lewis5 Small correction on one detail: Imitation learning from human demonstration video (without robot teleoperation data) is an appealing way to scale up training data cheaply, but it runs into the embodiment gap - human hand kinematics and force profiles don't map directly onto a robot hand's very different mechanism.
arjunsanchez
Posts: 74
Joined: Sun Nov 23, 2025 3:20 am

Re: What's the current gold standard dataset for training grasp policies?

Post by arjunsanchez »

Yeah, this tracks with what I've read as well. In-hand reorientation (repositioning a grasped object without setting it down) is one of the more advanced manipulation skills, requiring either a highly dexterous hand with enough DoF or clever use of gravity and controlled slipping - it's an active research area rather than a solved problem.
he/him | robotics hobbyist since the DARPA Grand Challenge days
Post Reply