Foundation Models

Bitter Lesson

The Bitter Lesson is the argument, articulated by Richard Sutton in a 2019 essay, that seventy years of AI research show general methods leveraging computation, chiefly search and learning, ultimately outperform approaches built on human-designed domain knowledge, which deliver short-term gains but plateau. The essay is invoked constantly in robotics debates over end-to-end learning versus modular pipelines built from human priors about geometry, dynamics, and task structure.

Why it matters for physical AI

Whether robotics obeys the Bitter Lesson is the field's live strategic question: data-and-compute scaling drives current foundation model bets, while physical constraints and data scarcity keep structured priors competitive.