Is it normal to have negative value for loss_kl_fwd

[yuxinyuan]

As the title suggests, is it normal to have a negative fwd loss, and how to deal with that?

[shengcanxu]

I have the same issue, don't know why.

[yuxinyuan]

I found a typo in my code which causes the weird loss