Anyone comparing PPO vs newer RL algorithms specifically for humanoid gait?

Whole-body control, RL policies, VLA models, sim-to-real, ROS2, and the software stack that makes a humanoid actually walk and act.
freya.sokolov
Posts: 60
Joined: Sun Mar 08, 2026 12:23 pm

Re: Anyone comparing PPO vs newer RL algorithms specifically for humanoid gait?

Post by freya.sokolov »

@carlossanchez From what I've seen: Model predictive control (MPC) is still very much alive in production humanoids, often working alongside or underneath learned policies - MPC handles short-horizon dynamically-consistent trajectory optimization while learned components handle perception, task-level decisions, or recovery behaviors that are hard to hand-model.
Ex-automotive, now full-time robots.
Post Reply