about scale_lr
Closed this issue · 1 comments
roywithfiringblade commented
In the experiment setting of PASCAL-5i, the initial lr is setting to 0.0025. But i saw that there was a scaler_lr in the poly_learning_rate(). And the default value is 10. So the initial lr is actually 0.025. right?
tianzhuotao commented
@704051419 In train.py, the index has been set as -1 which means the initial lr is scaled for all learnable parameters.
Details can be found at:
https://github.com/Jia-Research-Lab/PFENet/blob/master/train.py#L255
https://github.com/Jia-Research-Lab/PFENet/blob/master/util/util.py#L49
Thank you for mentioning it and sorry for the inconvenience.