| Conditional Boltzmann Machines (1985) |
|
|
|
|
|
|
|
|
|
|
|
|
|
| • | Conditional
BM: The visible units are |
|||||||||||
| divided into
“input” units that are |
||||||||||||
| clamped in both
phases and “output” |
||||||||||||
| units that are
only clamped in the |
||||||||||||
| positive phase. |
||||||||||||
| – | Because
the input units are |
|||||||||||
| always
clamped, the BM does not |
||||||||||||
| try
to model their distribution. It |
||||||||||||
| learns p(output | input). |
||||||||||||
|
|
|
|
|
|
|
|
|
|
| • | Standard
BM: The hidden |
||||||||
| units are not
clamped in |
|||||||||
| either phase. |
|||||||||
| • | The visible units are |
||||||||
| clamped in the
positive |
|||||||||
| phase and
unclamped in |
|||||||||
| the negative
phase. The |
|||||||||
| BM learns
p(visible). |
|||||||||
| output units |
| hidden units |
| hidden units |
| visible units |
| input units |