/binary_feature_selection

information theoretic feature selection for classifiers with binary features

Primary LanguagePython

binary_feature_selection

information theoretic feature selection for classifiers with binary features

The metrics

From the summary of the literature in Tang, Kay, He 2016; more detailed citations forthcoming

Mutual Information

img

Cross entropy for text

img

Information Gain

img

Chi-square statistic

img

GSS Coefficient

img