Non-linear neurons with smooth derivatives
For backpropagation, we need
neurons that have well-behaved
derivatives.
Typically they use the logistic
function
The output is a smooth
function of the inputs and the
weights.
1
0.5
0
Its odd to express it
in terms of y.
0