Anyone tried using suction as a hybrid supplement to a dexterous hand?

End effectors, dexterous hands, tendon drives, tactile fingertips, grasp planning, and teleoperation.
emilyperez
Posts: 246
Joined: Mon Oct 28, 2024 8:03 pm

Anyone tried using suction as a hybrid supplement to a dexterous hand?

Post by emilyperez »

Curious what people here think about this. Grasp planning for deformable or non-rigid objects (bags, cables, cloth) remains one of the genuinely unsolved problems in manipulation - rigid-body grasp models simply don't capture how the object will behave once contact starts. Vision-based grasp confidence estimation (predicting success before attempting a grasp) and tactile-based confirmation (confirming after contact) are complementary rather than competing - vision helps you choose a grasp, tactile tells you if it actually worked. Compliant wrists that absorb impact during a bad approach or misjudged contact reduce mechanical stress on the whole arm, which matters a lot for long-term reliability even though it's a less visible feature than the hand itself. Interested in both agreement and pushback here.
choi98
Posts: 220
Joined: Sat Oct 12, 2024 12:32 am

Re: Anyone tried using suction as a hybrid supplement to a dexterous hand?

Post by choi98 »

@emilyperez This matches what I've seen too. Object occlusion by the robot's own hand during the final approach to a grasp is a common and annoying perception problem - the closer the hand gets to a good grasp position, the more it blocks the camera's view of exactly what it's about to grab.
Watching this space closely since 2019.
kwilliams
Posts: 309
Joined: Sat Sep 21, 2024 1:57 pm

Re: Anyone tried using suction as a hybrid supplement to a dexterous hand?

Post by kwilliams »

@choi98 Appreciate the detailed answer. Cable routing through a wrist joint with multiple degrees of freedom is a genuinely tricky mechanical design problem - tendons and wiring both need enough slack to avoid binding through the full range of motion without tangling or fraying over thousands of cycles. This whole thread is a good reminder how young this field still is.
he/him
emilyperez
Posts: 246
Joined: Mon Oct 28, 2024 8:03 pm

Re: Anyone tried using suction as a hybrid supplement to a dexterous hand?

Post by emilyperez »

@kwilliams This matches what I've seen too. Underactuated hands (fewer actuators than joints, using mechanical coupling to shape the grasp) are a reasonable engineering compromise for robust power grasps on a budget, but they generally can't do fine in-hand manipulation the way a fully actuated hand can. Tendon-driven fingers let you move the heavier actuators back into the palm or forearm, keeping the fingers themselves light and fast, but they introduce cable routing, tensioning, and long-term wear problems that direct-actuated fingers don't have.
park44
Posts: 156
Joined: Sat Nov 30, 2024 12:03 am

Re: Anyone tried using suction as a hybrid supplement to a dexterous hand?

Post by park44 »

Worth being a little skeptical of the marketing angle here. Bimanual manipulation - two arms coordinating on one task - is harder than it looks mostly because of the added degrees of freedom and the timing/force coordination required; a lot of 'two-handed' demos are actually closer to two independent single-hand tasks done in sequence. A lot of the manipulation shown in production demos still leans heavily on teleoperation, particularly for anything involving fine force control or novel objects - autonomous grasp success rates on genuinely unstructured, previously-unseen clutter are still well below what teleoperation can achieve.
she/her
kwilliams
Posts: 309
Joined: Sat Sep 21, 2024 1:57 pm

Re: Anyone tried using suction as a hybrid supplement to a dexterous hand?

Post by kwilliams »

Short answer: Palm sensing gets less attention than fingertip sensing, but a lot of power grasps (holding a box, a tool handle) rely more on palm and lateral finger contact than fingertip contact, so under-sensing the palm can leave a real blind spot in grasp confidence. Wet, oily, or otherwise low-friction objects are still a genuine edge case for most current hands, since tactile sensing and grasp-force controllers are typically tuned and validated on dry, higher-friction test objects. Reminds me a bit of the early drone hobbyist scene, honestly.
he/him
erik_novi
Posts: 192
Joined: Sun Oct 13, 2024 6:23 am

Re: Anyone tried using suction as a hybrid supplement to a dexterous hand?

Post by erik_novi »

Related question - Imitation learning from human demonstration video (without robot teleoperation data) is an appealing way to scale up training data cheaply, but it runs into the embodiment gap - human hand kinematics and force profiles don't map directly onto a robot hand's very different mechanism. Figure's fourth-generation Dexterous Hand (on Figure 02/03) reportedly offers 16 degrees of freedom per hand with sensors integrated into each finger, aimed at fine force control tasks like handling small electronic components without crushing them.
she/her
pierregreen
Posts: 205
Joined: Thu Dec 12, 2024 11:01 am

Re: Anyone tried using suction as a hybrid supplement to a dexterous hand?

Post by pierregreen »

One nitpick - In-hand reorientation (repositioning a grasped object without setting it down) is one of the more advanced manipulation skills, requiring either a highly dexterous hand with enough DoF or clever use of gravity and controlled slipping - it's an active research area rather than a solved problem. Payload-to-hand-weight ratio varies a lot across current dexterous hands, and it's a meaningful tradeoff - more DoF and finer sensing generally means more actuators and mass in the hand itself, which eats into the arm's usable payload budget.
she/her
dchen
Posts: 182
Joined: Wed Nov 13, 2024 6:51 am

Re: Anyone tried using suction as a hybrid supplement to a dexterous hand?

Post by dchen »

@pierregreen That's the official framing, at least - reality tends to lag a bit. Payload-to-hand-weight ratio varies a lot across current dexterous hands, and it's a meaningful tradeoff - more DoF and finer sensing generally means more actuators and mass in the hand itself, which eats into the arm's usable payload budget. Vision-based grasp confidence estimation (predicting success before attempting a grasp) and tactile-based confirmation (confirming after contact) are complementary rather than competing - vision helps you choose a grasp, tactile tells you if it actually worked.
deborahperez
Posts: 279
Joined: Sat Aug 31, 2024 4:22 am

Re: Anyone tried using suction as a hybrid supplement to a dexterous hand?

Post by deborahperez »

From what I've seen: Vision-based grasp confidence estimation (predicting success before attempting a grasp) and tactile-based confirmation (confirming after contact) are complementary rather than competing - vision helps you choose a grasp, tactile tells you if it actually worked. Object occlusion by the robot's own hand during the final approach to a grasp is a common and annoying perception problem - the closer the hand gets to a good grasp position, the more it blocks the camera's view of exactly what it's about to grab.
Post Reply