Add answer_predfix to prevent model from refusing to answer typo?

Question

vkaul11 opened this issue 5 months ago · 2 comments

Do you mean answer_prefix in README. Is this like forced_generation? Model can still refuse to answer.

Answer 1 · 2024-05-29T23:06:49.000Z

We add answer prefix as the start tokens of assistant message. This can prevent model from refusing to answer.

Answer 2 · 2024-05-30T00:31:12.000Z

Yes I think there is typo saying answer_predfix which I think is a typo