Will Prodigy be added as optimizer ?
Closed this issue · 2 comments
Zolilio commented
From what I red on numerous posts and guide, Prodigy seems to be a direct upgrade from Dadaptation for adaptative optimizer. So I wonder if it can be added for the google colab.
hollowstrawberry commented
Hey, I haven't really seen anyone using this, do you have a reference?
hollowstrawberry commented
Found some example parameters here: https://rentry.org/59xed3#prodigy
Added in 232294d