Pro’s and Con’s of Gibbs sampling
Advantages of Gibbs sampling
Much faster mixing
Can be extended to use pooled second layer
(Max Welling)
Disadvantages of Gibbs sampling
Can only be used in deep networks by
learning hidden layers (or pairs of layers)
greedily.
But maybe this is OK. Its scales better than
contrastive backpropagation.