Page 1 of 2
What's a manipulation task everyone assumes is easy but really isn't?
Posted: Thu May 22, 2025 5:52 am
by deborahperez
Wanted to get this in front of people who actually know the space.
Palm sensing gets less attention than fingertip sensing, but a lot of power grasps (holding a box, a tool handle) rely more on palm and lateral finger contact than fingertip contact, so under-sensing the palm can leave a real blind spot in grasp confidence. A lot of the manipulation shown in production demos still leans heavily on teleoperation, particularly for anything involving fine force control or novel objects - autonomous grasp success rates on genuinely unstructured, previously-unseen clutter are still well below what teleoperation can achieve.
What's everyone else's take?
Re: What's a manipulation task everyone assumes is easy but really isn't?
Posted: Thu May 22, 2025 11:33 am
by pierregreen
@deborahperez Yeah, this tracks with what I've read as well.
Vision-based grasp confidence estimation (predicting success before attempting a grasp) and tactile-based confirmation (confirming after contact) are complementary rather than competing - vision helps you choose a grasp, tactile tells you if it actually worked. Compliant wrists that absorb impact during a bad approach or misjudged contact reduce mechanical stress on the whole arm, which matters a lot for long-term reliability even though it's a less visible feature than the hand itself.
Re: What's a manipulation task everyone assumes is easy but really isn't?
Posted: Thu May 22, 2025 12:33 pm
by ivan22
@pierregreen I see it a little differently.
Underactuated hands (fewer actuators than joints, using mechanical coupling to shape the grasp) are a reasonable engineering compromise for robust power grasps on a budget, but they generally can't do fine in-hand manipulation the way a fully actuated hand can. Wet, oily, or otherwise low-friction objects are still a genuine edge case for most current hands, since tactile sensing and grasp-force controllers are typically tuned and validated on dry, higher-friction test objects.
Totally unrelated but has anyone else noticed how fast component costs are dropping this year.
Re: What's a manipulation task everyone assumes is easy but really isn't?
Posted: Thu May 22, 2025 5:23 pm
by carlossanchez
@ivan22 Agreed, and I'd add:
Imitation learning from human demonstration video (without robot teleoperation data) is an appealing way to scale up training data cheaply, but it runs into the embodiment gap - human hand kinematics and force profiles don't map directly onto a robot hand's very different mechanism. Grasp planning for deformable or non-rigid objects (bags, cables, cloth) remains one of the genuinely unsolved problems in manipulation - rigid-body grasp models simply don't capture how the object will behave once contact starts.
Re: What's a manipulation task everyone assumes is easy but really isn't?
Posted: Thu May 22, 2025 7:17 pm
by kwilliams
@carlossanchez Small correction on one detail:
Payload-to-hand-weight ratio varies a lot across current dexterous hands, and it's a meaningful tradeoff - more DoF and finer sensing generally means more actuators and mass in the hand itself, which eats into the arm's usable payload budget. Cable routing through a wrist joint with multiple degrees of freedom is a genuinely tricky mechanical design problem - tendons and wiring both need enough slack to avoid binding through the full range of motion without tangling or fraying over thousands of cycles.
Re: What's a manipulation task everyone assumes is easy but really isn't?
Posted: Sun May 25, 2025 5:26 pm
by barbara50
Here's the relevant bit as far as I understand it:
In-hand reorientation (repositioning a grasped object without setting it down) is one of the more advanced manipulation skills, requiring either a highly dexterous hand with enough DoF or clever use of gravity and controlled slipping - it's an active research area rather than a solved problem.
Re: What's a manipulation task everyone assumes is easy but really isn't?
Posted: Tue May 27, 2025 10:44 pm
by deborahperez
New to this, so forgive me if this is obvious -
Figure's fourth-generation Dexterous Hand (on Figure 02/03) reportedly offers 16 degrees of freedom per hand with sensors integrated into each finger, aimed at fine force control tasks like handling small electronic components without crushing them.
Re: What's a manipulation task everyone assumes is easy but really isn't?
Posted: Wed May 28, 2025 5:00 pm
by carlossanchez
+1 to this. Worth adding:
Object occlusion by the robot's own hand during the final approach to a grasp is a common and annoying perception problem - the closer the hand gets to a good grasp position, the more it blocks the camera's view of exactly what it's about to grab. Bimanual manipulation - two arms coordinating on one task - is harder than it looks mostly because of the added degrees of freedom and the timing/force coordination required; a lot of 'two-handed' demos are actually closer to two independent single-hand tasks done in sequence.
Re: What's a manipulation task everyone assumes is easy but really isn't?
Posted: Sat May 31, 2025 4:37 pm
by emilyperez
@carlossanchez Speaking from personal experience here,
Tendon-driven fingers let you move the heavier actuators back into the palm or forearm, keeping the fingers themselves light and fast, but they introduce cable routing, tensioning, and long-term wear problems that direct-actuated fingers don't have.
Re: What's a manipulation task everyone assumes is easy but really isn't?
Posted: Tue Jun 03, 2025 2:32 am
by sarah.santos3
@emilyperez Small correction on one detail:
Imitation learning from human demonstration video (without robot teleoperation data) is an appealing way to scale up training data cheaply, but it runs into the embodiment gap - human hand kinematics and force profiles don't map directly onto a robot hand's very different mechanism.