Robot Learning

ACT (Action Chunking with Transformers)

ACT is an imitation learning algorithm, introduced by Zhao et al. in 2023 alongside the ALOHA teleoperation system, that trains a transformer to predict chunks of future actions rather than single steps. It is structured as a conditional variational autoencoder over demonstrations, and at test time overlapping chunks are blended by temporal ensembling. ACT achieved fine bimanual manipulation from only tens of demonstrations on low-cost hardware.

Why it matters for physical AI

ACT demonstrated that chunked action prediction mitigates compounding errors in behavior cloning, a design insight now standard in manipulation policies and vision-language-action models trained on teleoperated data.