google-deepmind/optax

Add a `nesterov` flag to `radam` optimizer

Closed this issue · 2 comments

carlosgmartin commented

Currently, the following optimizers receive a nesterov flag:

Feature request: Add a nesterov flag to the following optimizers:

vroulet commented

Hello @carlosgmartin,
Would you be willing to do a PR for this?
For the record, this paper provides some insights on radam.