Hopfield Nets
A Hopfield net is composed of binary threshold units with
recurrent connections between them. Recurrent
networks of non-linear units are generally very hard to
analyze. They can behave in many different ways:
Settle to a stable state
Oscillate
Follow chaotic trajectories that cannot be predicted
far into the future.
But Hopfield realized that if the connections are
symmetric, there is a global energy function
Each “configuration” of the network has an energy.
The binary threshold decision rule causes the network
to settle to an energy minimum.