Page 2 of 4

Re: Anyone using simulation-only training for grasp policies with zero real data?

Posted: Tue Aug 11, 2026 1:54 pm
by michaelroberts
@sandra_ivan Worth being a little skeptical of the marketing angle here. Grasp planning for deformable or non-rigid objects (bags, cables, cloth) remains one of the genuinely unsolved problems in manipulation - rigid-body grasp models simply don't capture how the object will behave once contact starts.

Re: Anyone using simulation-only training for grasp policies with zero real data?

Posted: Thu Aug 13, 2026 4:51 am
by amandawhite
@michaelroberts Slight correction, though the overall point stands: Bimanual manipulation - two arms coordinating on one task - is harder than it looks mostly because of the added degrees of freedom and the timing/force coordination required; a lot of 'two-handed' demos are actually closer to two independent single-hand tasks done in sequence.

Re: Anyone using simulation-only training for grasp policies with zero real data?

Posted: Sat Aug 15, 2026 1:11 pm
by young58
Just to be precise about one thing: Cable routing through a wrist joint with multiple degrees of freedom is a genuinely tricky mechanical design problem - tendons and wiring both need enough slack to avoid binding through the full range of motion without tangling or fraying over thousands of cycles. Tendon-driven fingers let you move the heavier actuators back into the palm or forearm, keeping the fingers themselves light and fast, but they introduce cable routing, tensioning, and long-term wear problems that direct-actuated fingers don't have.

Re: Anyone using simulation-only training for grasp policies with zero real data?

Posted: Tue Aug 18, 2026 8:13 am
by charlesbianchi
This is a great summary, thanks. In-hand reorientation (repositioning a grasped object without setting it down) is one of the more advanced manipulation skills, requiring either a highly dexterous hand with enough DoF or clever use of gravity and controlled slipping - it's an active research area rather than a solved problem. Figure's fourth-generation Dexterous Hand (on Figure 02/03) reportedly offers 16 degrees of freedom per hand with sensors integrated into each finger, aimed at fine force control tasks like handling small electronic components without crushing them.

Re: Anyone using simulation-only training for grasp policies with zero real data?

Posted: Mon Aug 24, 2026 8:58 am
by kwilliams
This matches what I've seen too. Grasp planning for deformable or non-rigid objects (bags, cables, cloth) remains one of the genuinely unsolved problems in manipulation - rigid-body grasp models simply don't capture how the object will behave once contact starts.

Re: Anyone using simulation-only training for grasp policies with zero real data?

Posted: Mon Aug 24, 2026 11:58 pm
by donna_wata
@kwilliams Slightly off-topic, but related: Object occlusion by the robot's own hand during the final approach to a grasp is a common and annoying perception problem - the closer the hand gets to a good grasp position, the more it blocks the camera's view of exactly what it's about to grab.

Re: Anyone using simulation-only training for grasp policies with zero real data?

Posted: Sun Aug 30, 2026 11:59 am
by young58
@donna_wata Follow-up question though - Bimanual manipulation - two arms coordinating on one task - is harder than it looks mostly because of the added degrees of freedom and the timing/force coordination required; a lot of 'two-handed' demos are actually closer to two independent single-hand tasks done in sequence.

Re: Anyone using simulation-only training for grasp policies with zero real data?

Posted: Sun Aug 30, 2026 11:59 am
by byang
@young58 I'd push back on this a bit. Bimanual manipulation - two arms coordinating on one task - is harder than it looks mostly because of the added degrees of freedom and the timing/force coordination required; a lot of 'two-handed' demos are actually closer to two independent single-hand tasks done in sequence. A lot of the manipulation shown in production demos still leans heavily on teleoperation, particularly for anything involving fine force control or novel objects - autonomous grasp success rates on genuinely unstructured, previously-unseen clutter are still well below what teleoperation can achieve. Reminds me a bit of the early drone hobbyist scene, honestly.

Re: Anyone using simulation-only training for grasp policies with zero real data?

Posted: Sun Aug 30, 2026 11:59 am
by johnrossi
@byang Yeah, this tracks with what I've read as well. Vision-based grasp confidence estimation (predicting success before attempting a grasp) and tactile-based confirmation (confirming after contact) are complementary rather than competing - vision helps you choose a grasp, tactile tells you if it actually worked. Grasp planning for deformable or non-rigid objects (bags, cables, cloth) remains one of the genuinely unsolved problems in manipulation - rigid-body grasp models simply don't capture how the object will behave once contact starts.

Re: Anyone using simulation-only training for grasp policies with zero real data?

Posted: Sun Aug 30, 2026 11:59 am
by pierregreen
@johnrossi Minor factual note: Vision-based grasp confidence estimation (predicting success before attempting a grasp) and tactile-based confirmation (confirming after contact) are complementary rather than competing - vision helps you choose a grasp, tactile tells you if it actually worked. Makes me wonder how this looks in another five years.