Contrastive divergence
Aim is
to minimize the amount by which a step toward equilibrium improves
the data distribution.
Minimize Contrastive Divergence
Minimize divergence between data distribution and model’s distribution
Maximize the divergence
between confabulations
and model’s
distribution
data distribution
model’s distribution
distribution after one step of Markov chain
