lessw2020/Ranger21

Can ranger be used for NLP transformers?

LifeIsStrange opened this issue · 2 comments

LifeIsStrange commented

e.g for improving BERT-large/XLnet ?
@lessw2020 friendly ping

lessw2020 commented

It should do well, though I have not used it expressly on NLP. I have used it extensively for vision transformers and it performed extremely well.

  • 👍1
LifeIsStrange commented

Thanks

  • 👍1