VIT-S initilization
G-JWLee opened this issue · 1 comments
G-JWLee commented
If I searched correctly, image mae does not provide Vit-S version. How did you initilized model weight when training on Vit-S?
yztongzhan commented
All our models are pre-trained from scratch on video datasets.