Page 6 of 6

Re: What's underrated: perception improvements or controller improvements, for overall reliability?

Posted: Mon Jun 29, 2026 1:23 am
by green28
@ivan22 This matches what I've seen too. Physical Intelligence's pi0 pairs a smaller pretrained vision-language backbone with a separate flow-matching 'action expert' module, which is one way to get fast, high-frequency action output without needing the whole giant language model to run at control-loop speed.

Re: What's underrated: perception improvements or controller improvements, for overall reliability?

Posted: Wed Jul 01, 2026 9:58 pm
by shill
@green28 I'll believe the stronger version of that claim when it's independently verified. Isaac Lab (the successor to Isaac Gym) is widely used for large-scale parallel RL training thanks to GPU-accelerated physics, while MuJoCo is often used as a secondary 'sim-to-sim' validation step because its contact dynamics are generally considered more realistic than Isaac's, even though it trains slower at scale.

Re: What's underrated: perception improvements or controller improvements, for overall reliability?

Posted: Sun Jul 05, 2026 11:57 pm
by rossi30
@shill Just to be precise about one thing: Model predictive control (MPC) is still very much alive in production humanoids, often working alongside or underneath learned policies - MPC handles short-horizon dynamically-consistent trajectory optimization while learned components handle perception, task-level decisions, or recovery behaviors that are hard to hand-model.

Re: What's underrated: perception improvements or controller improvements, for overall reliability?

Posted: Fri Jul 17, 2026 9:41 am
by freya.smith
Just to be precise about one thing: 'Zero-shot sim-to-real' rarely means literally zero real-world tuning in practice - it usually means the policy transfers well enough to be usable with only calibration and minor safety-limit adjustments, rather than needing a full additional training phase on hardware. OpenVLA is a notable open-source VLA model - roughly 7 billion parameters, trained on hundreds of thousands of real-world robot demonstrations - and has been shown to outperform much larger closed models on some manipulation benchmarks, which says a lot about how much of VLA performance comes from data curation rather than raw scale. Totally unrelated but has anyone else noticed how fast component costs are dropping this year.

Re: What's underrated: perception improvements or controller improvements, for overall reliability?

Posted: Mon Jul 20, 2026 10:42 am
by samuel.adams
From what I've seen: Model predictive control (MPC) is still very much alive in production humanoids, often working alongside or underneath learned policies - MPC handles short-horizon dynamically-consistent trajectory optimization while learned components handle perception, task-level decisions, or recovery behaviors that are hard to hand-model. Diffusion policies model the distribution of possible actions and sample from it, which handles multimodal manipulation tasks (multiple valid ways to grasp something) more naturally than a single deterministic action output, at the cost of slower inference.

Re: What's underrated: perception improvements or controller improvements, for overall reliability?

Posted: Wed Jul 29, 2026 5:49 pm
by nicole57
@samuel.adams Minor factual note: A lot of what reads as 'full autonomy' in public demos is closer to a mix of scripted state machines, teleoperation for the hardest sub-tasks, and autonomous execution for the easier, well-rehearsed parts - transparency about this mix varies a lot between companies.