Stochastic binary units
(Bernoulli variables)
1
These have a state of 1
or 0.
The probability of
turning on is determined
by the weighted input
from other units (plus a
bias)
0
0