Data & Benchmarks

RLDS

RLDS (Reinforcement Learning Datasets) is a dataset format and toolchain from Google for recording, storing, and consuming episodic decision-making data without loss of information, built on TensorFlow Datasets. It standardizes data as episodes of timesteps carrying observations, actions, and rewards with arbitrary metadata, and its adoption by the Open X-Embodiment collaboration made it a de facto interchange format for large-scale cross-robot demonstration data.

Why it matters for physical AI

Pooling robot data across labs and embodiments requires a common episodic schema, and RLDS supplied the standard that let dozens of datasets merge into the corpora behind generalist robot policies.