philschmid/sagemaker-huggingface-llama-2-samples

Does we need the prompt formatting during the instruct model fine-tuning?

mariababich opened this issue · 0 comments

Hello!

I was reviewing the notebooks and in the fine-tuning tutorials we do not do the prompt formatting with [INST], and other special tokens. I understand that we are free to chose any prompt template in case of fine-tuning the text-completion model. But in case of tuning the instruct model, should we follow the same prompt formatting as Meta recommend?