/DeepnetHessian

The Full Spectrum of Deepnet Hessians at Scale: Dynamics with SGD Training and Sample Size

Primary LanguageJupyter Notebook

The Full Spectrum of Deepnet Hessians at Scale:
Dynamics with SGD Training and Sample Size

Usage

See Jupyter notebook main.ipynb

Example

CIFAR10 VGG11 The spectrum of the train Hessian of VGG11 trained on CIFAR10. The plot was generated by exporting the data into a CSV file and plotting it with Tableau.