Advantages and disadvantages of decision
trees
They are easy to fit, easy to use, and easy to interpret as
a fixed sequence of simple tests. (Doctors like them.)
They are non-linear, so they work much better than
linear models for highly non-linear functions.
They typically generalize less well than non-linear
models that use adaptive basis functions, but its easy to
improve them by averaging the predictions of many trees
Each tree is fitted to a training set produced by
sampling the dataset with replacement (“Bagging”)
So much for interpretability!