zeke-xie/adaptive-inertia-adai
[ICML 2022, Oral] The PyTorch Implementation of Adaptive Inertia Methods. The algorithms are based on our paper: "Adaptive Inertia: Disentangling the Effects of Adaptive Learning Rate and Momentum".
PythonMIT
Issues
- 1
Test performance of adai on NLP tasks?
#7 opened by chinoll - 1
upload code to pypi
#6 opened by chinoll - 2
Update code for adaiW please
#5 opened by zhai-EE - 9
fit bortfeld function with adai and adam, adai cannot converge at the same learning rate
#4 opened by civerjia - 2
Linear layer state['step'] increament is 2
#3 opened by civerjia - 1
About combining with pnm
#2 opened by julightzhong10