OFA-Sys/gsm8k-ScRel

SFT

eyuansu62 opened this issue · 3 comments

eyuansu62 commented

Does SFT contain instruction tuning process?

GanjinZero commented

Only gsm8k fine tuning.

eyuansu62 commented

Have you ever planned to verify your findings on more LLM such as codeLLM? Cause I guess codeLLM may points to different conclusion.

GanjinZero commented

Not actually. We will now focus on 65B and 70B LLaMA to verify more scaling related conclusions.