Do you have pretrained model weights like ViT-S/16 or ViT-S/16？

Question

Do you have pretrained model weights like ViT-S/16 or ViT-S/16？

Closed this issue a year ago · 1 comments

Hi,Thanks for the cool work.
I am using Video-Swin-Transformer (Swin-S, Swin-B or Swin-L is too big for my device) .
I want to switch to your work. Do you have pretrained model weights like ViT-S/16 or ViT-T/16?

I am looking forward to hearing from you.

Answer 1 · 2023-02-23T20:50:45.000Z

Hi, thanks for your interest in our work. I don't have AIM pre-trained ViT-S or ViT-T. But you should be able to use imagenet pretrained ViT-S or ViT-T and tune it with AIM on your tasks.