Semi-restricted Boltzmann Machines

• We restrict the connectivity to make learning easier. • Contrastive divergence learning requires the hidden units to be in conditional equilibrium with the visibles. – But it does not require the visible units to be in conditional equilibrium with the hiddens. – All we require is that the visible units are closer to equilibrium in the reconstructions than in the data. • So we can allow connections between the visibles.

hidden

j

i

visible