14

Restricted Boltzmann Machines

• We restrict the connectivity to make inference and learning easier. – Only one layer of hidden units. – No connections between hidden units. • In an RBM, the hidden units are conditionally independent given the visible states. It only takes one step to reach thermal equilibrium when the visible units are clamped. – So we can quickly get the exact value of :

hidden

j

i

visible