 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
 |
| • |
Sometimes, the
error stays constant for a while
|
|
|
as nodes are
added and then it falls
|
|
|
|
– |
So
we cannot stop adding nodes as soon as
|
|
|
|
the
error stops falling.
|
|
|
| • |
It typically
works best to fit a tree that is too large
|
|
and then prune
back the least useful nodes to
|
|
|
|
balance
complexity against error
|
|
|
|
– |
We
could use a validation set to do the
|
|
|
pruning.
|
|