lora training - Input:Instruction
Yyyyyyxh opened this issue · 1 comments
Yyyyyyxh commented
research4pan commented
Thanks for your interest in LMFlow! server/app.py
didn't take prompt format into consideration. You may first use examples/chatbot.py
with --prompt_structure "Input: Instructions: {input_text} Output:"
. This will alleviate the problem. To make server/app.py
work, we can do the same string formatting by modifying the prompt format in line 116-123 (https://github.com/OptimalScale/LMFlow/blob/main/service/app.py#L116).
Hope that can solve your issue 🙏