CyberZHG/keras-radam

To use Warmup

huyhieupham opened this issue · 1 comments

huyhieupham commented

I think to use Warmup, the code should be:

from keras_radam import RAdam

RAdam(total_steps=10000, warmup_proportion=0.1, min_lr=1e-5)

with a "s" in "total_steps".

CyberZHG commented

Thanks. The document is updated.