| Two types of generative neural network |
|
|
|
|
|
|
|
|
|
|
|
|
|
| • | If we connect
binary stochastic neurons in a |
|||||||||||
| directed acyclic
graph we get a Sigmoid Belief |
||||||||||||
| Net (Radford Neal
1992). |
||||||||||||
| • | If we connect
binary stochastic neurons using |
|||||||||||
| symmetric
connections we get a Boltzmann |
||||||||||||
| Machine (Hinton
& Sejnowski, 1983). |
||||||||||||
| – | If
we restrict the connectivity in a special way, |
|||||||||||
| it
is easy to learn a Boltzmann machine. |
||||||||||||