A neural network for a product of nave
models
If you know which hidden units are
active, use the weights from all of the
active hidden units to determine the
probability of turning on a visible unit.
If you know which visible units are
active, use the weights from all of the
active visible units to determine the
probability of turning on a hidden
unit.
If you do not know the states, start
somewhere and alternate between
picking hidden states given visible
ones and picking visible states given
hidden ones.
hidden
units
visible
units
Alternating updates of the
hidden and visible units will
eventually sample from a
product distribution