•We used 16x16 image patches and
a single layer of 768 hidden units (3
x overcomplete).
•
•Confabulations are produced from
data by adding random momentum once and simulating dynamics
for 30 steps.
•
•Weights are updated every 100 examples.
•
•A small amount of weight decay helps.