not so funny
Closed this issue · 2 comments
imfinethanks commented
A.
B.you
C.need
D.1
E.2
F.ah
请问这个结果正常吗？看起来并不是很搞笑
zhongshsh commented
Your generated content is not a complete sentence. I suspect there might be an issue with your generation config. You may need to check generation_config.json (in checkpoint dir), especially if max_new_tokens in the config is mistakenly set to 1.
My generation during testing is normal. (See attached image, I find this response quite interesting, no offense intended).
imfinethanks commented
max_new_tokens=512没发现问题，不过环境从windows+pytorch2.2切换成ubuntu+pytorch2.0后正常了。
Awesome