Page 2 of 2

Re: Anyone tried teleoperation with force feedback gloves for training data collection?

Posted: Sun May 04, 2025 6:40 pm
by carlossanchez
+1 to this. Worth adding: Imitation learning from human demonstration video (without robot teleoperation data) is an appealing way to scale up training data cheaply, but it runs into the embodiment gap - human hand kinematics and force profiles don't map directly onto a robot hand's very different mechanism. A lot of the manipulation shown in production demos still leans heavily on teleoperation, particularly for anything involving fine force control or novel objects - autonomous grasp success rates on genuinely unstructured, previously-unseen clutter are still well below what teleoperation can achieve.

Re: Anyone tried teleoperation with force feedback gloves for training data collection?

Posted: Tue May 06, 2025 9:29 am
by scott21
@carlossanchez Just to be precise about one thing: Payload-to-hand-weight ratio varies a lot across current dexterous hands, and it's a meaningful tradeoff - more DoF and finer sensing generally means more actuators and mass in the hand itself, which eats into the arm's usable payload budget.

Re: Anyone tried teleoperation with force feedback gloves for training data collection?

Posted: Wed May 07, 2025 6:44 pm
by benjaminsanchez
@scott21 Appreciate the detailed answer. Grasp planning for deformable or non-rigid objects (bags, cables, cloth) remains one of the genuinely unsolved problems in manipulation - rigid-body grasp models simply don't capture how the object will behave once contact starts.

Re: Anyone tried teleoperation with force feedback gloves for training data collection?

Posted: Sun May 11, 2025 7:55 pm
by emilyperez
@benjaminsanchez Minor factual note: Payload-to-hand-weight ratio varies a lot across current dexterous hands, and it's a meaningful tradeoff - more DoF and finer sensing generally means more actuators and mass in the hand itself, which eats into the arm's usable payload budget. Underactuated hands (fewer actuators than joints, using mechanical coupling to shape the grasp) are a reasonable engineering compromise for robust power grasps on a budget, but they generally can't do fine in-hand manipulation the way a fully actuated hand can.

Re: Anyone tried teleoperation with force feedback gloves for training data collection?

Posted: Tue May 20, 2025 9:02 am
by rossi30
@emilyperez One nitpick - Grasp planning for deformable or non-rigid objects (bags, cables, cloth) remains one of the genuinely unsolved problems in manipulation - rigid-body grasp models simply don't capture how the object will behave once contact starts.

Re: Anyone tried teleoperation with force feedback gloves for training data collection?

Posted: Fri May 30, 2025 10:58 pm
by diego.moore6
@rossi30 This lines up with my experience. Tendon-driven fingers let you move the heavier actuators back into the palm or forearm, keeping the fingers themselves light and fast, but they introduce cable routing, tensioning, and long-term wear problems that direct-actuated fingers don't have. Figure's fourth-generation Dexterous Hand (on Figure 02/03) reportedly offers 16 degrees of freedom per hand with sensors integrated into each finger, aimed at fine force control tasks like handling small electronic components without crushing them.

Re: Anyone tried teleoperation with force feedback gloves for training data collection?

Posted: Wed Jun 04, 2025 4:27 am
by choi98
@diego.moore6 This matches what I've seen too. Underactuated hands (fewer actuators than joints, using mechanical coupling to shape the grasp) are a reasonable engineering compromise for robust power grasps on a budget, but they generally can't do fine in-hand manipulation the way a fully actuated hand can.

Re: Anyone tried teleoperation with force feedback gloves for training data collection?

Posted: Mon Jun 09, 2025 2:46 am
by chloe_jack
@choi98 One nitpick - Figure's fourth-generation Dexterous Hand (on Figure 02/03) reportedly offers 16 degrees of freedom per hand with sensors integrated into each finger, aimed at fine force control tasks like handling small electronic components without crushing them.

Re: Anyone tried teleoperation with force feedback gloves for training data collection?

Posted: Wed Jun 11, 2025 7:28 am
by jhansen
@chloe_jack Side note that might be relevant: A lot of the manipulation shown in production demos still leans heavily on teleoperation, particularly for anything involving fine force control or novel objects - autonomous grasp success rates on genuinely unstructured, previously-unseen clutter are still well below what teleoperation can achieve.