Robot Learning

Mixture Density Network (MDN)

A mixture density network (MDN) is a neural network, introduced by Bishop in 1994, whose outputs parameterize a mixture distribution, typically Gaussian mixture weights, means, and variances, rather than a single point prediction. Trained by maximizing likelihood, MDNs represent multimodal conditional distributions. In robot learning they have been used as policy heads to capture the multiple valid actions demonstrators take in identical situations.

Why it matters for physical AI

Averaging across valid strategies produces invalid actions, a core failure of naive behavior cloning; mixture heads were an early remedy and remain a lightweight alternative to diffusion-based action decoders.