Avoiding spurious minima by unlearning
Hopfield, Feinstein and Palmer suggested the following
strategy:
Let the net settle from a random initial state and then
do unlearning.
This will get rid of deep , spurious minima and
increase memory capacity.
Crick and Mitchison proposed unlearning as a model of
what dreams are for.
That’s why you don’t remember them
(Unless you wake up during the dream)
But how much unlearning should we do?
And can we analyze what unlearning achieves?