BloodAxe/pytorch-toolbelt

Source on BalancedBCEWithLogitsLoss

davidhuangal opened this issue · 5 comments

davidhuangal commented

I was wondering if there is a paper or even just a description on the BalancedBCEWithLogitsLoss ?

BloodAxe commented

Hi! Indeed, there are. See https://arxiv.org/pdf/1504.06375.pdf formula 2.
Will update the code for the future release with proper docs.

  • 🎉1
davidhuangal commented

Thank you very much!

davidhuangal commented

I have two more questions about this loss function: what does the parameter gamma correspond with in formula 2 since there isn't a gamma symbol in it, and how does it effect the loss?

BloodAxe commented

The gamma is a my addition to this loss, when gamma=1, it's equal to vanilla BBCE as in Formula 2. Values >1 decay the balancing weights. E.g if gamma = 2, and positives fraction is 0.25 and negatives is 0.75, corresponding weights will be 0.25^2 and 0.75^ accordingly.

  • 👍1
davidhuangal commented

Got it, that makes sense. Thank you again.