Foundation Models

Grounded Language Understanding

Grounded language understanding is the capability of connecting linguistic expressions to their referents in the physical world, so that phrases like "the mug left of the laptop" resolve to specific percepts, spatial relations, and feasible actions rather than remaining abstract tokens. In robotics it spans referring-expression resolution, spatial and affordance grounding, and instruction following, pursued historically with structured semantic parsers and now dominantly with vision-language models fine-tuned on embodied data.

Why it matters for physical AI

Natural language is the interface through which non-experts will command robots, and grounding failures, confidently manipulating the wrong object, are among the most consequential error modes of language-driven systems.