The wake-sleep algorithm

• Wake phase: Use the recognition weights to perform a bottom-up pass. – Train the generative weights to reconstruct activities in each layer from the layer above. • Sleep phase: Use the generative weights to generate samples from the model. – Train the recognition weights to reconstruct activities in each layer from the layer below.

h3

h2

h1

data