Learning a semi-restricted Boltzmann Machine

1. Start with a training vector on the visible units. 2. Update all of the hidden units in parallel 3. Repeatedly update all of the visible units in parallel using mean-field updates (with the hiddens fixed) to get a “reconstruction”. 4. Update all of the hidden units again.

j

j

i

k

i

k

i

k

i

k

reconstruction

data

update for a lateral weight