small question about lr_scheduler
huixiancheng opened this issue · 3 comments
huixiancheng commented
yuanli2333 commented
Hi, lr_scheduler is the method to set up lr decay in training, such as multi-step decay and cosine decay. We use cosine decay in this work.
huixiancheng commented
yuanli2333 commented
You need update ls in each epoch to tell it current epoch, which is the ls usage in torch.