Problem about the process of generate
Closed this issue · 4 comments
Hello. Thank you for your contributions about these code. After I finished training the model, the loss decreases normly. But when I generate, as your suggestion, the model tends to output a series of identical numbers. I am confused about this. Could please tell me something about this or upload a pretrained model. Thank you very much
@ujscjj Thank you for interest to my repository.
Unfortunately, I'm also suffered from this issue.
So now I've some experiments & debugging to fix this both model and pre-processing wise.
please wait for a second.
Or,If you have some idea about this issue, I'm very thankful that you report to this repo's issue.
Tank you.
hello,
Have you tried the Hyper Parameters you set on your code? Does it work?
I tried to increase h but failed because out of memory. Then I reduced max sequence length but the model didn't work well.
@Jackaryyy I think you should both set small batch size to this model and GPU with at least V100.
I trained on this env, and worked well. thank you.
I am still having the same problem. Is this problem fixed?