Robot Learning

Hybrid Imitation RL

Hybrid imitation RL is the family of methods that combine demonstrations with reinforcement learning, either by pretraining a policy with behavior cloning and fine-tuning it with RL, by placing demonstrations in the replay buffer of an off-policy learner (as in DDPGfD, DAPG, and RLPD), or by shaping rewards from demonstration state distributions. The combination addresses RL's exploration problem while allowing the policy to exceed demonstrator performance.

Why it matters for physical AI

Imitation gets policies working quickly but plateaus at human quality and coverage; layering RL on top pushes success rates toward the near-perfect reliability commercial deployments require.