Background

Decision trees are hierarchical data structures functioning as classifier systems. They are constructed based on a set of training data for which the value of the target function is known (i.e. Supervised Learning). Internal (decision) nodes of the tree are created based on information characteristics of the data. A refresher: image