ZhengxiangShi/InstructionModelling

Questions about using huggingface trainer training

mst272 opened this issue · 1 comments

mst272 commented

Thanks for your research.
If huggingface trainer is used for training, theoretically, can we just convert the instruction part with the original label of -100 into its normal input_ids?

ZhengxiangShi commented

Thanks for your question. Yes, you can.

  • 👍1