Robot Learning

SERL

SERL (Sample-Efficient Robotic reinforcement Learning) is an open-source software suite from UC Berkeley (Luo et al., 2024) for training reinforcement learning policies directly on real manipulators, combining a high update-to-data ratio off-policy learner seeded with demonstrations, learned reward classifiers, and automatic environment resets. It demonstrated tasks like PCB insertion and cable routing learned in tens of minutes of real interaction. The HIL-SERL follow-up added human-in-the-loop corrections, reaching near-perfect success on contact-rich tasks.

Why it matters for physical AI

SERL made real-world RL reproducible for ordinary labs, showing that on-robot reinforcement learning can polish policies past the ceiling of pure imitation on precision tasks.