The wake-sleep algorithm
Wake phase: Use the
recognition weights to perform a
bottom-up pass.
Train the generative weights
to reconstruct activities in
each layer from the layer
above.
Sleep phase: Use the generative
weights to generate samples
from the model.
Train the recognition weights
to reconstruct activities in
each layer from the layer
below.
h3
h2
h1
data