openai/weak-to-strong

How to use GPT-4 as strong model

sr5434 opened this issue · 1 comments

sr5434 commented

Hi! How would I go about using GPT-4 as a strong model to finetune GPT-2? Also, how expensive would it be(in terms of OpenAI API costs)?

notlober commented

it is weak to strong generalization, which you use gpt2 labels to train larger model eg. gpt4. not other way.