Some weights of T5ForConditionalGeneration were not initialized from the model checkpoint at google/flan-t5-base and are newly initialized: ['temp']
ClarkQian opened this issue · 1 comments
ClarkQian commented
Thank you very much for your outstanding work. However, when I was training vg_swinT.yaml, I encountered the following issue:
Some weights of T5ForConditionalGeneration were not initialized from the model checkpoint at google/flan-t5-base and are newly initialized: ['temp']
You should probably TRAIN this model on a downstream task to be able to use it for predictions and inference.
Moreover, the training results were only:
AP | AP50 | AP75 | APs | APm | APl | APr | APc | APf |
---|---|---|---|---|---|---|---|---|
0.013 | 0.027 | 0.010 | 0.001 | 0.007 | 0.057 | 0.000 | 0.001 | 0.025 |
Is this issue caused by the flan-t5-base model not loading correctly? I hope to get your advice on this matter. Thank you.
xuxinxin99 commented
I get the same rersults with you, you are not alone! Hope for the author to answer it @clin1223