/debugNNwithWandB

Concepts Explored in/with Pytorch

Primary LanguageJupyter NotebookApache License 2.0Apache-2.0

debugNNwithWandB

Contain notebooks to showcase various aspects mentioned.

Notebook Name W&B Run/Project Page
MNIST_pytorch_wandb_Overfit_Small.ipynb overfitsmall
MNIST_pytorch_wandb_LRFinder.ipynb lrfinder-1, lrfinder-2, lfinder-3, lrfinder-4, lrfinder-5, lrfinder-6
MNIST_pytorch_wandb_Vanishing_Gradient.ipynb Vanishing_Grad_1, VG_Converge, VG_solved_Relu
MNIST_pytorch_wandb_Exploding_Gradient.ipynb Explode_Bad_Wt
Pytorch_wandb_Exploding_Gradient_NaN.ipynb after_nan
Cifar10_pytorch_wandb_Wt_Init.ipynb run_without_wt, run_with_wt
Cifar10_pytorch_wandb_Dropout_BN.ipynb base_model, dropout_model, batch_norm, bn_drop