nlpyang/BertSum

I got xent of 3-4 after 30000 training steps, is this normal?

Anothernewcomer opened this issue · 1 comments

xent started out aroud 40-50, rapidly decrease to 3-4 and seemed to stop deceasing, Is this normal or is there something wrong with my data? Pleases guys give me some replys o(╥﹏╥)o

I had the same problem, xent rapidly decrease to around 80 and stuck here, do you solve the problem?