Page 3 of 3

Re: What's your favorite open-source locomotion RL framework right now?

Posted: Sat May 23, 2026 6:16 pm
by nschmidt
@niklassantos Agreed, and I'd add: Diffusion policies model the distribution of possible actions and sample from it, which handles multimodal manipulation tasks (multiple valid ways to grasp something) more naturally than a single deterministic action output, at the cost of slower inference. OpenVLA is a notable open-source VLA model - roughly 7 billion parameters, trained on hundreds of thousands of real-world robot demonstrations - and has been shown to outperform much larger closed models on some manipulation benchmarks, which says a lot about how much of VLA performance comes from data curation rather than raw scale.

Re: What's your favorite open-source locomotion RL framework right now?

Posted: Thu May 28, 2026 3:00 pm
by thomasmitchell
Just to be precise about one thing: A lot of what reads as 'full autonomy' in public demos is closer to a mix of scripted state machines, teleoperation for the hardest sub-tasks, and autonomous execution for the easier, well-rehearsed parts - transparency about this mix varies a lot between companies. Isaac Lab (the successor to Isaac Gym) is widely used for large-scale parallel RL training thanks to GPU-accelerated physics, while MuJoCo is often used as a secondary 'sim-to-sim' validation step because its contact dynamics are generally considered more realistic than Isaac's, even though it trains slower at scale.

Re: What's your favorite open-source locomotion RL framework right now?

Posted: Sun Jun 07, 2026 10:24 am
by emma_whit
Minor factual note: Whole-body control (WBC) formulates locomotion and manipulation as a single optimization problem across all joints simultaneously, respecting contact constraints and task priorities - it's more general than ZMP-only approaches but is computationally heavier and harder to tune.

Re: What's your favorite open-source locomotion RL framework right now?

Posted: Mon Jun 15, 2026 3:49 am
by shill
Worth being a little skeptical of the marketing angle here. ROS2 remains common in research and early-stage products for its tooling and ecosystem, but a number of production humanoid companies run custom, more tightly-optimized middleware for their real-time control loops, using ROS2-like tooling mainly for development, visualization, and non-real-time subsystems.

Re: What's your favorite open-source locomotion RL framework right now?

Posted: Thu Jun 18, 2026 10:11 pm
by joseph31
Short answer: ROS2 remains common in research and early-stage products for its tooling and ecosystem, but a number of production humanoid companies run custom, more tightly-optimized middleware for their real-time control loops, using ROS2-like tooling mainly for development, visualization, and non-real-time subsystems. Sim-to-real transfer still commonly breaks on contact dynamics - friction, restitution, and deformable/compliant surfaces are the hardest things to model accurately in simulation, so policies trained purely in sim often need real-world fine-tuning specifically around contact-rich tasks.

Re: What's your favorite open-source locomotion RL framework right now?

Posted: Sun Jun 21, 2026 4:14 am
by nicole57
I'd take that specific number with a grain of salt, honestly. Diffusion policies model the distribution of possible actions and sample from it, which handles multimodal manipulation tasks (multiple valid ways to grasp something) more naturally than a single deterministic action output, at the cost of slower inference.