An infinite sigmoid belief net
that is equivalent to an RBM
etc.
h2
The distribution generated by this
infinite directed net with replicated
weights is the equilibrium distribution
for a compatible pair of conditional
distributions: p(v|h) and p(h|v) that
are both defined by W
A top-down pass of the directed
net is exactly equivalent to letting
a Restricted Boltzmann Machine
settle to equilibrium.
So this infinite directed net
defines the same distribution as
an RBM.
v2
h1
v1
h0
v0