Kaggle competition, score from 0.78 to 0.8 above by decision tree. Most improvements were done by digging out more information from existing dataset.
There're a couple of tries from first_tree.R to sixth_tree.R, all changes described in the R code file.