Decision trees are a simple but powerful prediction method. Figure 1: A classification decision tree is built by partitioning the predictor variable to reduce class mixing at each split. Figure 2 ...

However, even data that can be perfectly divided into classes by a hyperplane may require a large decision tree if only simple threshold tests are used.