Page 2 of 3

Re: Teleoperation for manipulation data collection - what rigs are people using?

Posted: Sun Nov 10, 2024 12:07 am
by kwilliams
@emilyperez One nitpick - A lot of the manipulation shown in production demos still leans heavily on teleoperation, particularly for anything involving fine force control or novel objects - autonomous grasp success rates on genuinely unstructured, previously-unseen clutter are still well below what teleoperation can achieve. Makes me wonder how this looks in another five years.

Re: Teleoperation for manipulation data collection - what rigs are people using?

Posted: Mon Nov 11, 2024 6:10 am
by zoeanderson
@kwilliams Minor factual note: Figure's fourth-generation Dexterous Hand (on Figure 02/03) reportedly offers 16 degrees of freedom per hand with sensors integrated into each finger, aimed at fine force control tasks like handling small electronic components without crushing them. Vision-based grasp confidence estimation (predicting success before attempting a grasp) and tactile-based confirmation (confirming after contact) are complementary rather than competing - vision helps you choose a grasp, tactile tells you if it actually worked.

Re: Teleoperation for manipulation data collection - what rigs are people using?

Posted: Mon Nov 11, 2024 11:15 pm
by matthew43
@zoeanderson Worth being a little skeptical of the marketing angle here. Bimanual manipulation - two arms coordinating on one task - is harder than it looks mostly because of the added degrees of freedom and the timing/force coordination required; a lot of 'two-handed' demos are actually closer to two independent single-hand tasks done in sequence. In-hand reorientation (repositioning a grasped object without setting it down) is one of the more advanced manipulation skills, requiring either a highly dexterous hand with enough DoF or clever use of gravity and controlled slipping - it's an active research area rather than a solved problem.

Re: Teleoperation for manipulation data collection - what rigs are people using?

Posted: Sat Nov 16, 2024 5:20 pm
by scott.andersson5
Side note that might be relevant: In-hand reorientation (repositioning a grasped object without setting it down) is one of the more advanced manipulation skills, requiring either a highly dexterous hand with enough DoF or clever use of gravity and controlled slipping - it's an active research area rather than a solved problem. Tendon-driven fingers let you move the heavier actuators back into the palm or forearm, keeping the fingers themselves light and fast, but they introduce cable routing, tensioning, and long-term wear problems that direct-actuated fingers don't have.

Re: Teleoperation for manipulation data collection - what rigs are people using?

Posted: Sun Nov 17, 2024 9:26 am
by kwilliams
@scott.andersson5 Speaking from personal experience here, A lot of the manipulation shown in production demos still leans heavily on teleoperation, particularly for anything involving fine force control or novel objects - autonomous grasp success rates on genuinely unstructured, previously-unseen clutter are still well below what teleoperation can achieve.

Re: Teleoperation for manipulation data collection - what rigs are people using?

Posted: Mon Nov 18, 2024 2:59 pm
by servoken70
@kwilliams This is exactly the kind of context I was looking for. Wet, oily, or otherwise low-friction objects are still a genuine edge case for most current hands, since tactile sensing and grasp-force controllers are typically tuned and validated on dry, higher-friction test objects.

Re: Teleoperation for manipulation data collection - what rigs are people using?

Posted: Wed Nov 20, 2024 10:48 am
by deborahperez
Still learning the space, so correct me if wrong - Cable routing through a wrist joint with multiple degrees of freedom is a genuinely tricky mechanical design problem - tendons and wiring both need enough slack to avoid binding through the full range of motion without tangling or fraying over thousands of cycles.

Re: Teleoperation for manipulation data collection - what rigs are people using?

Posted: Tue Nov 26, 2024 11:43 am
by kwilliams
@deborahperez Yeah, this tracks with what I've read as well. Tendon-driven fingers let you move the heavier actuators back into the palm or forearm, keeping the fingers themselves light and fast, but they introduce cable routing, tensioning, and long-term wear problems that direct-actuated fingers don't have.

Re: Teleoperation for manipulation data collection - what rigs are people using?

Posted: Mon Dec 02, 2024 1:55 am
by williams84
@kwilliams Here's what I know on this: Grasp planning for deformable or non-rigid objects (bags, cables, cloth) remains one of the genuinely unsolved problems in manipulation - rigid-body grasp models simply don't capture how the object will behave once contact starts. Makes me wonder how this looks in another five years.

Re: Teleoperation for manipulation data collection - what rigs are people using?

Posted: Wed Dec 04, 2024 4:06 pm
by emilyperez
Just to be precise about one thing: In-hand reorientation (repositioning a grasped object without setting it down) is one of the more advanced manipulation skills, requiring either a highly dexterous hand with enough DoF or clever use of gravity and controlled slipping - it's an active research area rather than a solved problem.