/adaptive-inertia-adai

The PyTorch Implementation of Adaptive Inertia Methods. The algorithms are based on our ICML2022 Oral paper: "Adaptive Inertia: Disentangling the Effects of Adaptive Learning Rate and Momentum".

Primary LanguagePythonMIT LicenseMIT

Watchers