An infinite sigmoid belief net that is equivalent to an RBM

etc.

h2

• The distribution generated by this infinite directed net with replicated weights is the equilibrium distribution for a compatible pair of conditional distributions: p(v|h) and p(h|v) that are both defined by W – A top-down pass of the directed net is exactly equivalent to letting a Restricted Boltzmann Machine settle to equilibrium. – So this infinite directed net defines the same distribution as an RBM.

v2

h1

v1

h0

v0