Robot Learning

Keyframe Selection

Keyframe selection is the identification of a sparse set of salient frames or waypoints that summarize a trajectory, demonstration, or video. In robot learning, keyframe-based imitation trains policies to predict bottleneck end-effector poses, as in systems like C2FARM and PerAct, shortening effective horizons; in visual SLAM, keyframes are the subset of camera frames retained for mapping and bundle adjustment.

Why it matters for physical AI

Predicting a handful of decisive waypoints instead of dense action streams improves sample efficiency and long-horizon reliability, a recurring trick behind data-efficient manipulation learners.