lucidrains/performer-pytorch

Huge model state dict size?

Liyue1d opened this issue · 0 comments

Hi,

I am getting very heavy files (100MB) when I am saving a module containing the PerformerLM module the recommended way. (torch.save(model.state_dict(), 'path')).

I tried with a PerformerLM module only that I just initialized and am having the same issue. Is this normal?