A stack of RBM’s (Yee-Whye Teh’s idea)

hL

• Each RBM has the same subscript as its hidden layer. • Each RBM defines its own distribution over its visible vectors • Each RBM defines its own distribution over its hidden vectors

h2

h1

v