Pretrain modell
Elvares opened this issue · 1 comments
Elvares commented
Hi, I want to train model for translation pascal2java. I have small datasets about 2 Gb of pascal and 2 Gb of java. I train model mlm and then train transcoder model but translation doesn't work. When I try to translate pascal2java I got same function of pascal or bad translation of java. It can be problem with small dataset or overfittig?
Elvares commented
also when I train mlm model and then try to use it for transcoder model I got
Is it problem?