PhoGPT-7B5-Instruct has only one word repeated over and over again.
hacbachvotu opened this issue · 10 comments
PhoGPT-7B5-Instruct has only one word repeated over and over again when i generate! Why does this error appear, everyone? I only have this problem with this model.
Closed!
Following the same question from you in this thread: #4
You may want to install pytorch, transformers, and/or run the example code (on Google Colab) with GPU.
Closed! Following the same question from you in this thread: #4 You might want to install torch, transformers, and/or run the example code (on Google Colab) with GPU.
I have installed all with the latest version and all other models run smoothly except this one.
#4 (comment)
CUDA_VISIBLE_DEVICES=0 python testscript.py
would generate "Xin chào. Tôi có thể giúp gì cho bạn?".
#4 (comment) CUDA_VISIBLE_DEVICES=0 python testscript.py would generate "Xin chào. Tôi có thể giúp gì cho bạn?".
sorry i don't know what did you say! i use oobabooga with GPU 12GB 3080ti.
everything ok when i use another model. I don't understand why only this model of yours is having problems.
You may want to enable trust-remote-code.
You may want to enable
trust-remote-code.
Thanks for you help! It's work with trust-remote-code Flag.
For the model to work properly, you might need to insert/use the PROMPT template "### Câu hỏi:\n{instruction}\n\n### Trả lời:".
For the model to work properly, you might need to insert/use the PROMPT template
"### Câu hỏi:\n{instruction}\n\n### Trả lời:".
Let me ask one more question: is it correct to put this prompt in oobooga?
Câu hỏi:\n{instruction}\n\n### Trả lời:"
For the model to work properly, you might need to insert/use the PROMPT template
"### Câu hỏi:\n{instruction}\n\n### Trả lời:".
Let me ask one more question: is it correct to put this prompt in oobooga?
do you know how to correct this?, i have same question