| A model of digit recognition |
|
|
|
|
|
|
| The
top two layers form an |
|||||
| associative
memory whose |
|||||
| energy
landscape models the low |
|||||
| dimensional
manifolds of the |
|||||
| digits. |
|||||
| The
energy valleys have names |
|||||
| 2000 top-level neurons |
|
|
| 10 label |
|
| neurons |
|
| 500 neurons |
|
|
|
|
|
|
|
| The model learns
to generate |
||||||
| combinations of
labels and images. |
||||||
| To perform
recognition we start with a |
||||||
| neutral state of
the label units and do |
||||||
| an up-pass from
the image followed |
||||||
| by a few
iterations of the top-level |
||||||
| associative memory. |
||||||
| 500 neurons |
|
|
|
| 28 x 28 |
||
| pixel |
||
| image |
||