A picture of why averaging is bad
target
Average of all the
other
predictors
Do we really want to
move the output of
predictor i away from
the target value?
