gpauloski/kfac-pytorch

Check if all KFAC tensors in cuda mem

Closed this issue · 1 comments

Both Kfac (10) and just sgd use 5.2 GB of vram with resnet 50. Both use 50-56 GB of ram.

Confirmed