|
|
|
| Learning constraints from natural images |
||
| (Yee-Whye Teh) |
||
|
|
|
|
|
|
|
|
|
| • | We used 16x16
image patches and a single |
|||||||
| layer of 768
hidden units (3 x
overcomplete). |
||||||||
| • | Confabulations
are produced from data by |
|||||||
| adding random
momentum once and simulating |
||||||||
| dynamics for 30
steps. |
||||||||
| • | Weights are
updated every 100 examples. |
|||||||
| • | A small amount of
weight decay helps. |
|||||||