Is it normal to have negative value for loss_kl_fwd
Closed this issue · 2 comments
yuxinyuan commented
As the title suggests, is it normal to have a negative fwd loss, and how to deal with that?
shengcanxu commented
I have the same issue, don't know why.
yuxinyuan commented
I found a typo in my code which causes the weird loss