A Warmup Scheduler for Pytorch to achieve the warmup learning rate at the beginning of training.
Primary LanguagePythonMIT LicenseMIT