openai/weak-to-strong

what's the meaning of fraction of GPT4?

ljch2018 opened this issue · 2 comments

ljch2018 commented
image I read the original paper, but met some problems about the graph.
  1. What's the meaning of fraction of GPT4 (X-axis) ?
  2. Is one line stand for a different student model?

Thank you very much.

zidong-onepiece1 commented

1.The fraction of GPT4 (X-axis) may represents the size of the student model, '1' represents GPT4, 10^-2 represents GPT4 parameters * 0.01 and so on.
2. one line represents weak model conpute. The lighter the color, the greater the weak model conpute.

WuTheFWasThat commented

zidong is correct except that 10^(-2) doesn't necessarily mean parameters * 0.01, it means less parameters and trained for 0.01x the compute