cortwave/cdiscount-kaggle

Nadam optimizer

Closed this issue · 1 comments

arsenyinfo commented

As we see good results with bigger batch, adding Nesterov momentum should work in a similar way

arsenyinfo commented

approximately same results as with Adam