bzamecnik/ml

Why are you using binary cross entropy

Closed this issue · 1 comments

Hey this is really cool work. Is there are a reason you are using binary cross entropy loss over categorical cross entropy loss given that this seems to be a multiclass classification problem in this sample https://github.com/bzamecnik/ml/blob/master/chord-recognition/lstm_chord_classification_training.py

Hi, it is multi-label classification, ie. N independent binary classifiers, each with sigmoid non-linearity and binary_crossentropy. Softmax would make it dependent and normalize it, so that there's a single class.