Source code from the book Tree-based Machine Learning Algorithms by Clinton Sheppard
You will learn not only how to use decision trees and random forests for classification and regression, and their respective limitations, but also how the algorithms that build them work. Each chapter introduces a new data concern and then walks you through modifying the code, thus building the engine just-in-time. Along the way you will gain experience making decision trees and random forests work for you.
Available from major stores including Amazon and Barnes & Noble, in paperback and Kindle formats.
- https://www.amazon.com/Tree-based-Machine-Learning-Algorithms-Decision/dp/1975860977 ISBN-13: 978-1-975-86097-4 (paperback)
- https://www.amazon.com/dp/B0756FGJCP/ (Kindle Edition)
A brief introduction to decision trees
Chapter 1: Branching
- uses a greedy algorithm to build a decision tree from data that can be split on a single attribute.
Chapter 2: Multiple Branches
- examines several ways to split data in order to generate multi-level decision trees.
Chapter 3: Continuous Attributes
- adds the ability to split numeric attributes using greater-than.
Chapter 4: Pruning
- explore ways of reducing the amount of error encoded in the tree.
Chapter 5: Random Forests
- introduces ensemble learning and feature engineering.
Chapter 6: Regression Trees
- investigates numeric predictions, like age, price, and miles per gallon.
Chapter 7: Boosting
- adjusts the voting power of the randomly selected decision trees in the random forest in order to improve its ability to predict outcomes.