Page 1 of 4

Anyone building grasp datasets specifically for warehouse-style clutter?

Posted: Fri Jun 19, 2026 2:27 pm
by park44
Wanted to get this in front of people who actually know the space. Wet, oily, or otherwise low-friction objects are still a genuine edge case for most current hands, since tactile sensing and grasp-force controllers are typically tuned and validated on dry, higher-friction test objects. Payload-to-hand-weight ratio varies a lot across current dexterous hands, and it's a meaningful tradeoff - more DoF and finer sensing generally means more actuators and mass in the hand itself, which eats into the arm's usable payload budget. Open to being corrected on the specifics.

Re: Anyone building grasp datasets specifically for warehouse-style clutter?

Posted: Fri Jun 19, 2026 4:47 pm
by kwilliams
Follow-up question though - Cable routing through a wrist joint with multiple degrees of freedom is a genuinely tricky mechanical design problem - tendons and wiring both need enough slack to avoid binding through the full range of motion without tangling or fraying over thousands of cycles. Grasp planning for deformable or non-rigid objects (bags, cables, cloth) remains one of the genuinely unsolved problems in manipulation - rigid-body grasp models simply don't capture how the object will behave once contact starts.

Re: Anyone building grasp datasets specifically for warehouse-style clutter?

Posted: Fri Jun 19, 2026 9:12 pm
by chloe_jack
Slight correction, though the overall point stands: Palm sensing gets less attention than fingertip sensing, but a lot of power grasps (holding a box, a tool handle) rely more on palm and lateral finger contact than fingertip contact, so under-sensing the palm can leave a real blind spot in grasp confidence. Bimanual manipulation - two arms coordinating on one task - is harder than it looks mostly because of the added degrees of freedom and the timing/force coordination required; a lot of 'two-handed' demos are actually closer to two independent single-hand tasks done in sequence.

Re: Anyone building grasp datasets specifically for warehouse-style clutter?

Posted: Sat Jun 20, 2026 1:24 am
by pierregreen
Respectfully, I think this undersells it a bit. Object occlusion by the robot's own hand during the final approach to a grasp is a common and annoying perception problem - the closer the hand gets to a good grasp position, the more it blocks the camera's view of exactly what it's about to grab. This whole thread is a good reminder how young this field still is.

Re: Anyone building grasp datasets specifically for warehouse-style clutter?

Posted: Sat Jun 20, 2026 1:38 am
by thomasmitchell
@pierregreen Pretty much this. One thing to add: In-hand reorientation (repositioning a grasped object without setting it down) is one of the more advanced manipulation skills, requiring either a highly dexterous hand with enough DoF or clever use of gravity and controlled slipping - it's an active research area rather than a solved problem.

Re: Anyone building grasp datasets specifically for warehouse-style clutter?

Posted: Sun Jun 21, 2026 2:58 am
by noah_pate
Related question - Figure's fourth-generation Dexterous Hand (on Figure 02/03) reportedly offers 16 degrees of freedom per hand with sensors integrated into each finger, aimed at fine force control tasks like handling small electronic components without crushing them. Vision-based grasp confidence estimation (predicting success before attempting a grasp) and tactile-based confirmation (confirming after contact) are complementary rather than competing - vision helps you choose a grasp, tactile tells you if it actually worked.

Re: Anyone building grasp datasets specifically for warehouse-style clutter?

Posted: Sun Jun 21, 2026 10:25 pm
by sarahbernard
Not sure I fully agree here. Imitation learning from human demonstration video (without robot teleoperation data) is an appealing way to scale up training data cheaply, but it runs into the embodiment gap - human hand kinematics and force profiles don't map directly onto a robot hand's very different mechanism. Compliant wrists that absorb impact during a bad approach or misjudged contact reduce mechanical stress on the whole arm, which matters a lot for long-term reliability even though it's a less visible feature than the hand itself.

Re: Anyone building grasp datasets specifically for warehouse-style clutter?

Posted: Tue Jun 23, 2026 9:00 am
by karentaylor
Ran into exactly this myself. A lot of the manipulation shown in production demos still leans heavily on teleoperation, particularly for anything involving fine force control or novel objects - autonomous grasp success rates on genuinely unstructured, previously-unseen clutter are still well below what teleoperation can achieve. Underactuated hands (fewer actuators than joints, using mechanical coupling to shape the grasp) are a reasonable engineering compromise for robust power grasps on a budget, but they generally can't do fine in-hand manipulation the way a fully actuated hand can.

Re: Anyone building grasp datasets specifically for warehouse-style clutter?

Posted: Tue Jun 23, 2026 7:59 pm
by carlossanchez
@karentaylor Same conclusion I've come to. Also worth noting: Palm sensing gets less attention than fingertip sensing, but a lot of power grasps (holding a box, a tool handle) rely more on palm and lateral finger contact than fingertip contact, so under-sensing the palm can leave a real blind spot in grasp confidence. Compliant wrists that absorb impact during a bad approach or misjudged contact reduce mechanical stress on the whole arm, which matters a lot for long-term reliability even though it's a less visible feature than the hand itself.

Re: Anyone building grasp datasets specifically for warehouse-style clutter?

Posted: Thu Jun 25, 2026 10:19 am
by scott21
Small correction on one detail: Tendon-driven fingers let you move the heavier actuators back into the palm or forearm, keeping the fingers themselves light and fast, but they introduce cable routing, tensioning, and long-term wear problems that direct-actuated fingers don't have.