 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
| • |
Hopfield,
Feinstein and Palmer suggested the following
|
|
|
strategy:
|
|
|
|
– |
Let
the net settle from a random initial state and then
|
|
do
unlearning.
|
|
|
|
– |
This
will get rid of deep , spurious minima and
|
|
|
increase
memory capacity.
|
|
|
| • |
Crick and
Mitchison proposed unlearning as a model of
|
|
|
what dreams are
for.
|
|
|
|
– |
That’s
why you don’t remember them
|
|
|
|
(Unless
you wake up during the dream)
|
|
|
| • |
But how much
unlearning should we do?
|
|
|
|
– |
And
can we analyze what unlearning achieves?
|
|