Another computational role for Hopfield nets
Hidden units. Used to
represent an interpretation
of the inputs
Instead of using the net to store
memories, use it to construct
interpretations of sensory input.
The input is represented by the
visible units.
The interpretation is represented by
the states of the hidden units.
The badness of the interpretation is
represented by the energy
This raises two difficult issues:
How do we escape from poor local
minima to get good interpretations?
How do we learn the weights on
connections to the hidden units?
Visible units. Used to
represent the inputs