Anyone building grasp datasets specifically for warehouse-style clutter?

[benjaminsanchez]

@scott21 Small correction on one detail: Palm sensing gets less attention than fingertip sensing, but a lot of power grasps (holding a box, a tool handle) rely more on palm and lateral finger contact than fingertip contact, so under-sensing the palm can leave a real blind spot in grasp confidence. Grasp planning for deformable or non-rigid objects (bags, cables, cloth) remains one of the genuinely unsolved problems in manipulation - rigid-body grasp models simply don't capture how the object will behave once contact starts.

[rossi30]

@benjaminsanchez Appreciate the detailed answer. Palm sensing gets less attention than fingertip sensing, but a lot of power grasps (holding a box, a tool handle) rely more on palm and lateral finger contact than fingertip contact, so under-sensing the palm can leave a real blind spot in grasp confidence.

[jchen]

@rossi30 Slight correction, though the overall point stands: Wet, oily, or otherwise low-friction objects are still a genuine edge case for most current hands, since tactile sensing and grasp-force controllers are typically tuned and validated on dry, higher-friction test objects. Grasp planning for deformable or non-rigid objects (bags, cables, cloth) remains one of the genuinely unsolved problems in manipulation - rigid-body grasp models simply don't capture how the object will behave once contact starts.

[nschmidt]

This matches what I've seen too. Figure's fourth-generation Dexterous Hand (on Figure 02/03) reportedly offers 16 degrees of freedom per hand with sensors integrated into each finger, aimed at fine force control tasks like handling small electronic components without crushing them.

[karen.chen3]

@nschmidt Just to be precise about one thing: In-hand reorientation (repositioning a grasped object without setting it down) is one of the more advanced manipulation skills, requiring either a highly dexterous hand with enough DoF or clever use of gravity and controlled slipping - it's an active research area rather than a solved problem.

[edward.nelson]

@karen.chen3 I'd push back on this a bit. A lot of the manipulation shown in production demos still leans heavily on teleoperation, particularly for anything involving fine force control or novel objects - autonomous grasp success rates on genuinely unstructured, previously-unseen clutter are still well below what teleoperation can achieve. Underactuated hands (fewer actuators than joints, using mechanical coupling to shape the grasp) are a reasonable engineering compromise for robust power grasps on a budget, but they generally can't do fine in-hand manipulation the way a fully actuated hand can.

[mia.weber]

@edward.nelson Can I ask a dumb follow-up - A lot of the manipulation shown in production demos still leans heavily on teleoperation, particularly for anything involving fine force control or novel objects - autonomous grasp success rates on genuinely unstructured, previously-unseen clutter are still well below what teleoperation can achieve. Figure's fourth-generation Dexterous Hand (on Figure 02/03) reportedly offers 16 degrees of freedom per hand with sensors integrated into each finger, aimed at fine force control tasks like handling small electronic components without crushing them. Totally unrelated but has anyone else noticed how fast component costs are dropping this year.

[jonathan.rao1]

I see it a little differently. Underactuated hands (fewer actuators than joints, using mechanical coupling to shape the grasp) are a reasonable engineering compromise for robust power grasps on a budget, but they generally can't do fine in-hand manipulation the way a fully actuated hand can.

[sven.wilson4]

Same conclusion I've come to. Also worth noting: A lot of the manipulation shown in production demos still leans heavily on teleoperation, particularly for anything involving fine force control or novel objects - autonomous grasp success rates on genuinely unstructured, previously-unseen clutter are still well below what teleoperation can achieve. Payload-to-hand-weight ratio varies a lot across current dexterous hands, and it's a meaningful tradeoff - more DoF and finer sensing generally means more actuators and mass in the hand itself, which eats into the arm's usable payload budget.

[ashley_flor]

From what I've seen: Bimanual manipulation - two arms coordinating on one task - is harder than it looks mostly because of the added degrees of freedom and the timing/force coordination required; a lot of 'two-handed' demos are actually closer to two independent single-hand tasks done in sequence.