Excellent work! Where is the code for teacher model training?

Question

Excellent work! Where is the code for teacher model training?

Closed this issue 6 months ago · 2 comments

Answer 1 · 2024-03-13T02:45:58.000Z

That's a good question.
In our paper, we use PromptSRC to pre-train our ViT-L/14 CLIP teacher model.
In this repo, you can change PromptKD/scripts/promptsrc/base2new_train.sh line 11 CFG=vit_b16_c2_ep20_batch4_4+4ctx to vit_l14_c2_ep20_batch8_4+4ctx.
Then follow the instructions in PromptKD/docs/PromptSRC.md and train your own teacher model.

Answer 2 · 2024-03-13T08:11:58.000Z

Thank you for your helpful reply!