What is “linear” classification?
Classification is intrinsically non-linear
It puts non-identical things in the same class, so a
difference in the input vector sometimes causes zero
change in the answer (what does this show?)
“Linear classification” means that the part that adapts is
linear
The adaptive part is followed by a fixed non-linearity.
It may also be preceded by a fixed non-linearity (e.g.
nonlinear basis functions).
fixed non-
linear function
adaptive linear
function