Intuitive motivation
It is silly to run the Markov chain all the way to
equilibrium if we can get the information required
for learning in just a few steps.
The way in which the model systematically
distorts the data distribution in the first few
steps tells us a lot about how the model is
But the model could have strong modes far
from any data. These modes will not be
sampled by confabulations. Is this a problem
in practice?