Page 2 of 3

Re: Handling contact-rich manipulation in sim - still painful in 2026?

Posted: Sat Apr 11, 2026 1:54 am
by erik_novi
@johnrossi Same conclusion I've come to. Also worth noting: Isaac Lab (the successor to Isaac Gym) is widely used for large-scale parallel RL training thanks to GPU-accelerated physics, while MuJoCo is often used as a secondary 'sim-to-sim' validation step because its contact dynamics are generally considered more realistic than Isaac's, even though it trains slower at scale.

Re: Handling contact-rich manipulation in sim - still painful in 2026?

Posted: Mon Apr 13, 2026 10:13 am
by rebecca_lefe
Appreciate the detailed answer. Whole-body control (WBC) formulates locomotion and manipulation as a single optimization problem across all joints simultaneously, respecting contact constraints and task priorities - it's more general than ZMP-only approaches but is computationally heavier and harder to tune.

Re: Handling contact-rich manipulation in sim - still painful in 2026?

Posted: Thu Apr 16, 2026 12:45 am
by garcia51
Not sure I fully agree here. Diffusion policies model the distribution of possible actions and sample from it, which handles multimodal manipulation tasks (multiple valid ways to grasp something) more naturally than a single deterministic action output, at the cost of slower inference. Reminds me a bit of the early drone hobbyist scene, honestly.

Re: Handling contact-rich manipulation in sim - still painful in 2026?

Posted: Thu Apr 23, 2026 12:43 am
by arjunsanchez
One nitpick - A lot of what reads as 'full autonomy' in public demos is closer to a mix of scripted state machines, teleoperation for the hardest sub-tasks, and autonomous execution for the easier, well-rehearsed parts - transparency about this mix varies a lot between companies. This whole thread is a good reminder how young this field still is.

Re: Handling contact-rich manipulation in sim - still painful in 2026?

Posted: Thu Apr 23, 2026 11:40 am
by deborahperez
Still learning the space, so correct me if wrong - 'Zero-shot sim-to-real' rarely means literally zero real-world tuning in practice - it usually means the policy transfers well enough to be usable with only calibration and minor safety-limit adjustments, rather than needing a full additional training phase on hardware. Isaac Lab (the successor to Isaac Gym) is widely used for large-scale parallel RL training thanks to GPU-accelerated physics, while MuJoCo is often used as a secondary 'sim-to-sim' validation step because its contact dynamics are generally considered more realistic than Isaac's, even though it trains slower at scale. Makes me wonder how this looks in another five years.

Re: Handling contact-rich manipulation in sim - still painful in 2026?

Posted: Wed Apr 29, 2026 5:00 am
by nancy_lewi
@deborahperez This is exactly the kind of context I was looking for. Model predictive control (MPC) is still very much alive in production humanoids, often working alongside or underneath learned policies - MPC handles short-horizon dynamically-consistent trajectory optimization while learned components handle perception, task-level decisions, or recovery behaviors that are hard to hand-model. Makes me wonder how this looks in another five years.

Re: Handling contact-rich manipulation in sim - still painful in 2026?

Posted: Mon May 04, 2026 7:18 pm
by zoeanderson
Slight correction, though the overall point stands: Zero Moment Point (ZMP) control keeps the robot's center of pressure within its support polygon and has been the classical backbone of bipedal walking for two decades - it's robust and well-understood, but tends to produce a somewhat conservative, flat-footed gait compared to more dynamic approaches.

Re: Handling contact-rich manipulation in sim - still painful in 2026?

Posted: Sat May 16, 2026 5:55 am
by greta78
@zoeanderson Just to be precise about one thing: Zero Moment Point (ZMP) control keeps the robot's center of pressure within its support polygon and has been the classical backbone of bipedal walking for two decades - it's robust and well-understood, but tends to produce a somewhat conservative, flat-footed gait compared to more dynamic approaches.

Re: Handling contact-rich manipulation in sim - still painful in 2026?

Posted: Mon May 25, 2026 2:56 pm
by lbianchi
@greta78 Here's what I know on this: OpenVLA is a notable open-source VLA model - roughly 7 billion parameters, trained on hundreds of thousands of real-world robot demonstrations - and has been shown to outperform much larger closed models on some manipulation benchmarks, which says a lot about how much of VLA performance comes from data curation rather than raw scale. Model predictive control (MPC) is still very much alive in production humanoids, often working alongside or underneath learned policies - MPC handles short-horizon dynamically-consistent trajectory optimization while learned components handle perception, task-level decisions, or recovery behaviors that are hard to hand-model.

Re: Handling contact-rich manipulation in sim - still painful in 2026?

Posted: Sat Jun 06, 2026 10:14 am
by harmonicjen60
Short answer: Zero Moment Point (ZMP) control keeps the robot's center of pressure within its support polygon and has been the classical backbone of bipedal walking for two decades - it's robust and well-understood, but tends to produce a somewhat conservative, flat-footed gait compared to more dynamic approaches.