coetaur0/ESIM

training loss is not reduced and accuracy is not improved during training

lipingtang17 opened this issue · 1 comments

lipingtang17 commented

Dear author,

When I was running train_mnli.py and train_snli.py, I met the same device problem with #15. Then I set the device of idx_range (line 40-41 in esim/utils.py) to the correct device and it was solved.
396d7d00343b6b0b603916421b9f1a2

(I don't know whether this change leads to the following problem so I list the change here.)

But I met a new problem, i.e., the training loss is not reduced and accuracy is not improved during training.
69ba4609f904f4274251520b3658157
image

Could you please help me on this? Thanks a lot!

lipingtang17 commented

The problem has been found. It is my word embeddings.