Ranger Optimizer extension

[misrasaurabh1]

Ranger optimizer https://medium.com/@lessw/new-deep-learning-optimizer-ranger-synergistic-combination-of-radam-lookahead-for-the-best-of-2dc83f79a48d https://arxiv.org/abs/1907.08610v1 Is a new optimizer that reports state of the art optimization performance for Deep Networks. The interesting thing is that Ranger uses RAdam as the base optimizer.
As you have the best library for RAdam implementation in Tensorflow and Keras, can I request you to consider extending your work to include Lookahead as well?

[CyberZHG]

See keras-lookahead:

from keras_radam import RAdam
from keras_lookahead import Lookahead

optimizer = Lookahead(RAdam())

[misrasaurabh1]

Wow, that was quick. Thank you!