 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
| • |
Advantages of
Gibbs sampling
|
|
|
|
– |
Much
faster mixing
|
|
|
|
– |
Can
be extended to use pooled second layer
|
|
(Max
Welling)
|
|
|
| • |
Disadvantages of
Gibbs sampling
|
|
|
|
– |
Can
only be used in deep networks by
|
|
|
learning
hidden layers (or pairs of layers)
|
|
|
greedily.
|
|
|
|
– |
But
maybe this is OK. Its scales better than
|
|
|
contrastive
backpropagation.
|
|