How do you evaluate whether a grasp policy is overfit to its training object set?
Re: How do you evaluate whether a grasp policy is overfit to its training object set?
One nitpick -
Wet, oily, or otherwise low-friction objects are still a genuine edge case for most current hands, since tactile sensing and grasp-force controllers are typically tuned and validated on dry, higher-friction test objects.
they/them
-
zoeanderson
- Posts: 243
- Joined: Sat Oct 26, 2024 2:39 am
Re: How do you evaluate whether a grasp policy is overfit to its training object set?
Minor factual note:
Underactuated hands (fewer actuators than joints, using mechanical coupling to shape the grasp) are a reasonable engineering compromise for robust power grasps on a budget, but they generally can't do fine in-hand manipulation the way a fully actuated hand can.
Re: How do you evaluate whether a grasp policy is overfit to its training object set?
Counterpoint:
Underactuated hands (fewer actuators than joints, using mechanical coupling to shape the grasp) are a reasonable engineering compromise for robust power grasps on a budget, but they generally can't do fine in-hand manipulation the way a fully actuated hand can.
Totally unrelated but has anyone else noticed how fast component costs are dropping this year.
"The best actuator is the one that doesn't overheat."
-
benjaminsanchez
- Posts: 180
- Joined: Fri Apr 18, 2025 1:58 am
Re: How do you evaluate whether a grasp policy is overfit to its training object set?
@wei_ross Genuinely curious -
Bimanual manipulation - two arms coordinating on one task - is harder than it looks mostly because of the added degrees of freedom and the timing/force coordination required; a lot of 'two-handed' demos are actually closer to two independent single-hand tasks done in sequence.
Re: How do you evaluate whether a grasp policy is overfit to its training object set?
@benjaminsanchez Agreed, and I'd add:
Compliant wrists that absorb impact during a bad approach or misjudged contact reduce mechanical stress on the whole arm, which matters a lot for long-term reliability even though it's a less visible feature than the hand itself.
Reminds me a bit of the early drone hobbyist scene, honestly.
he/him
Re: How do you evaluate whether a grasp policy is overfit to its training object set?
Thanks for laying this out, genuinely useful.
Grasp planning for deformable or non-rigid objects (bags, cables, cloth) remains one of the genuinely unsolved problems in manipulation - rigid-body grasp models simply don't capture how the object will behave once contact starts. Wet, oily, or otherwise low-friction objects are still a genuine edge case for most current hands, since tactile sensing and grasp-force controllers are typically tuned and validated on dry, higher-friction test objects.
-
benjaminsanchez
- Posts: 180
- Joined: Fri Apr 18, 2025 1:58 am
Re: How do you evaluate whether a grasp policy is overfit to its training object set?
Just to be precise about one thing:
Vision-based grasp confidence estimation (predicting success before attempting a grasp) and tactile-based confirmation (confirming after contact) are complementary rather than competing - vision helps you choose a grasp, tactile tells you if it actually worked. Compliant wrists that absorb impact during a bad approach or misjudged contact reduce mechanical stress on the whole arm, which matters a lot for long-term reliability even though it's a less visible feature than the hand itself.
Re: How do you evaluate whether a grasp policy is overfit to its training object set?
@benjaminsanchez Not sure I fully agree here.
Cable routing through a wrist joint with multiple degrees of freedom is a genuinely tricky mechanical design problem - tendons and wiring both need enough slack to avoid binding through the full range of motion without tangling or fraying over thousands of cycles.
Re: How do you evaluate whether a grasp policy is overfit to its training object set?
Minor factual note:
Compliant wrists that absorb impact during a bad approach or misjudged contact reduce mechanical stress on the whole arm, which matters a lot for long-term reliability even though it's a less visible feature than the hand itself. Palm sensing gets less attention than fingertip sensing, but a lot of power grasps (holding a box, a tool handle) rely more on palm and lateral finger contact than fingertip contact, so under-sensing the palm can leave a real blind spot in grasp confidence.
-
carol.robinson
- Posts: 153
- Joined: Sun Mar 16, 2025 11:36 am
Re: How do you evaluate whether a grasp policy is overfit to its training object set?
Here's what I know on this:
Wet, oily, or otherwise low-friction objects are still a genuine edge case for most current hands, since tactile sensing and grasp-force controllers are typically tuned and validated on dry, higher-friction test objects. A lot of the manipulation shown in production demos still leans heavily on teleoperation, particularly for anything involving fine force control or novel objects - autonomous grasp success rates on genuinely unstructured, previously-unseen clutter are still well below what teleoperation can achieve.
they/them