Why dont use chat template for chat model?
Closed this issue · 1 comments
eyuansu62 commented
It is an uncommon approach to directly input a prompt string into a chat model without using a chat template, which may result in unexpected behavior.
wenhuchen commented
We tried with chat template, the performance is lower for few-shot learning. The chat template are mostly used in zero-shot for some models.