Whether this code is used for self-supervised learning?
Epiphqny opened this issue · 2 comments
Epiphqny commented
Why the model loads pretrained weights?
lucidrains commented
@Epiphqny Hi Yuqing, that's just an example, you would train it from scratch!
Epiphqny commented
@lucidrains Ok, thanks for your awesome work!