Pretrained models

[WilhelmT]

Hi, will you release any pre-trained models?

Thank you

[gupta-abhay]

At some point, I'll take a call if this is worth pursuing. It's a very long training schedule as pointed out in the paper. And unless I can find a sustainable way to do this, I will not train the model beyond 1 epoch or so.