请问您的模型是否是一个freeze的vit提取query feature，然后再用相同的Vit进行继续训练？

Question

请问您的模型是否是一个freeze的vit提取query feature，然后再用相同的Vit进行继续训练？

LemonQC opened this issue 3 years ago · 2 comments

Answer 1 · 2022-05-15T13:15:56.000Z

应该是这样的，看源代码是这样

Answer 2 · 2022-06-20T19:07:15.000Z

Thanks for Yuxian's answer. Exactly, we use the same pretrained ViT copy for query feature extraction, and then we use another copy (starting from the same initialized weights) for training.