Code for the paper: Why Transformers Need Adam: A Hessian Perspective
Primary LanguageJupyter Notebook