[X-CLIP] Now it's no drop_out in clip?

Question

[X-CLIP] Now it's no drop_out in clip?

laisimiao opened this issue a year ago · 2 comments

I see
https://github.com/microsoft/VideoX/blob/1f07a646e3b989d2c39b725944217597deb31be9/X-CLIP/models/cct.py#LL8C50-L8C50
but in clip(openai) source code, they do not use drop_out operation and no DropPath module can be loaded from clip.model, could you explain the reason, thanks so much!

laisimiao commented a year ago

@nbl97

Answer 1 · 2023-05-18T09:43:24.000Z

Thanks for your interest. DropPath is a common technique used to overcome the overfitting in training large models. We add this skill to the codebase, but eventually we do not use that, i.e., the drop_path_rate is set to 0.