lucidrains/vit-pytorch

MAE Training

mw9385 opened this issue · 0 comments

mw9385 commented

Hi, I am trying to train MAE with my custom dataset (number of dataset: 200k). But I think it is not easy to train (overfitting happens) from scratch as it has very limited data. What I want to do is loading a pretrained model from Ross's work like this method (#196). Is there any other way I could load pretrained model for MAE?

Thanks