JRC1995/DemonRangerOptimizer

HyperRangerMod do not work

hadaev8 opened this issue · 3 comments

hadaev8 commented 
/content/DemonRangerOptimizer/optimizers.py in step(self, display, activate_IA, closure)
    883                 denom = vt.pow_(group['p']).add_(group['eps'])
    884 
--> 885                 n = state['lr']/denom
    886 
    887                 if beta3 > 0.0:  # apply AdaMod

KeyError: 'lr'
saurabh-kataria commented

I added state['lr'] = group['lr'] after line 814, since it is done in class HyperRanger.

hadaev8 commented

Yes, its just a typo

JRC1995 commented

Thanks for pointing out. Updated it.