Non-linear neurons with smooth derivatives
•
For backpropagation, we need
neurons that have well-behaved
derivatives.
–
Typically they use the logistic
function
–
The output is a smooth
function of the inputs and the
weights.
1
0.5
0
Its odd to express it
in terms of y.
0