facebookresearch/madgrad

Regret analysis

Closed this issue · 1 comments

samanemami commented

Do you have a regret analysis of your optimizer?

Thanks!

adefazio commented

The tech report contains an analysis in the stochastic setting rather than the online setting so its not a regret analysis exactly but a convergence rate bound:
https://arxiv.org/abs/2101.11075

  • 👍1