Vision-based vs tactile-based grasp confidence - which do you trust more?

End effectors, dexterous hands, tendon drives, tactile fingertips, grasp planning, and teleoperation.
choi98
Posts: 220
Joined: Sat Oct 12, 2024 12:32 am

Re: Vision-based vs tactile-based grasp confidence - which do you trust more?

Post by choi98 »

To answer this directly: Tendon-driven fingers let you move the heavier actuators back into the palm or forearm, keeping the fingers themselves light and fast, but they introduce cable routing, tensioning, and long-term wear problems that direct-actuated fingers don't have. A lot of the manipulation shown in production demos still leans heavily on teleoperation, particularly for anything involving fine force control or novel objects - autonomous grasp success rates on genuinely unstructured, previously-unseen clutter are still well below what teleoperation can achieve.
Watching this space closely since 2019.
mia_lars
Posts: 174
Joined: Wed Dec 25, 2024 11:00 am

Re: Vision-based vs tactile-based grasp confidence - which do you trust more?

Post by mia_lars »

Not to derail, but this reminds me of something adjacent: Underactuated hands (fewer actuators than joints, using mechanical coupling to shape the grasp) are a reasonable engineering compromise for robust power grasps on a budget, but they generally can't do fine in-hand manipulation the way a fully actuated hand can. Kind of makes me think about how different this all looked even three years ago.
Watching this space closely since 2019.
scott.andersson5
Posts: 172
Joined: Sat Nov 02, 2024 8:39 pm

Re: Vision-based vs tactile-based grasp confidence - which do you trust more?

Post by scott.andersson5 »

Short answer: In-hand reorientation (repositioning a grasped object without setting it down) is one of the more advanced manipulation skills, requiring either a highly dexterous hand with enough DoF or clever use of gravity and controlled slipping - it's an active research area rather than a solved problem. Vision-based grasp confidence estimation (predicting success before attempting a grasp) and tactile-based confirmation (confirming after contact) are complementary rather than competing - vision helps you choose a grasp, tactile tells you if it actually worked.
scott21
Posts: 256
Joined: Fri Oct 11, 2024 9:57 am

Re: Vision-based vs tactile-based grasp confidence - which do you trust more?

Post by scott21 »

Worth being a little skeptical of the marketing angle here. In-hand reorientation (repositioning a grasped object without setting it down) is one of the more advanced manipulation skills, requiring either a highly dexterous hand with enough DoF or clever use of gravity and controlled slipping - it's an active research area rather than a solved problem. Payload-to-hand-weight ratio varies a lot across current dexterous hands, and it's a meaningful tradeoff - more DoF and finer sensing generally means more actuators and mass in the hand itself, which eats into the arm's usable payload budget.
she/her
kwilliams
Posts: 309
Joined: Sat Sep 21, 2024 1:57 pm

Re: Vision-based vs tactile-based grasp confidence - which do you trust more?

Post by kwilliams »

This lines up with my experience. Cable routing through a wrist joint with multiple degrees of freedom is a genuinely tricky mechanical design problem - tendons and wiring both need enough slack to avoid binding through the full range of motion without tangling or fraying over thousands of cycles. Palm sensing gets less attention than fingertip sensing, but a lot of power grasps (holding a box, a tool handle) rely more on palm and lateral finger contact than fingertip contact, so under-sensing the palm can leave a real blind spot in grasp confidence.
he/him
Post Reply