Missing keys while trying to load pretrained models

Question

Missing keys while trying to load pretrained models

simon-at-hypothetic opened this issue 2 years ago · 6 comments

simon-at-hypothetic commented 2 years ago

Hello,

I tried to load a pretrained models from here
https://web.northeastern.edu/smilelab/xuma/pointMLP/checkpoints/fixstd/modelnet40/pointMLP-20220209053148-404/
using the mlp_nocuda code shared here
https://web.northeastern.edu/smilelab/xuma/pointMLP/pointmlp_nocuda.py

I get this error

RuntimeError: Error(s) in loading state_dict for Model:
	Missing key(s) in state_dict: "embedding.net.0.weight", "embedding.net.1.weight", "embedding.net.1.bias", "embedding.net.1.running_mean", "embedding.net.1.running_var", "local_grouper_list.0.affine_alpha", "local_grouper_list.0.affine_beta", "local_grouper_list.1.affine_alpha", "local_grouper_list.1.affine_beta", "local_grouper_list.2.affine_alpha", "local_grouper_list.2.affine_beta", "local_grouper_list.3.affine_alpha", "local_grouper_list.3.affine_beta", "pre_blocks_list.0.transfer.net.0.weight", "pre_blocks_list.0.transfer.net.1.weight", "pre_blocks_list.0.transfer.net.1.bias", "pre_blocks_list.0.transfer.net.1.running_mean", "pre_blocks_list.0.transfer.net.1.running_var", "pre_blocks_list.0.operation.0.net1.0.weight", "pre_blocks_list.0.operation.0.net1.1.weight", "pre_blocks_list.0.operation.0.net1.1.bias", "pre_blocks_list.0.operation.0.net1.1.running_mean", "pre_blocks_list.0.operation.0.net1.1.running_var", "pre_blocks_list.0.operation.0.net2.0.weight", "pre_blocks_list.0.operation.0.net2.1.weight", "pre_blocks_list.0.operation.0.net2.1.bias", "pre_blocks_list.0.operation.0.net2.1.running_mean", "pre_blocks_list.0.operation.0.net2.1.running_var", "pre_blocks_list.0.operation.1.net1.0.weight", "pre_blocks_list.0.operation.1.net1.1.weight", "pre_blocks_list.0.operation.1.net1.1.bias", "pre_blocks_list.0.operation.1.net1.1.running_mean", "pre_blocks_list.0.operation.1.net1.1.running_var", "pre_blocks_list.0.operation.1.net2.0.weight", "pre_blocks_list.0.operation.1.net2.1.weight", "pre_blocks_list.0.operation.1.net2.1.bias", "pre_blocks_list.0.operation.1.net2.1.running_mean", "pre_blocks_list.0.operation.1.net2.1.running_var", "pre_blocks_list.1.transfer.net.0.weight", "pre_blocks_list.1.transfer.net.1.weight", "pre_blocks_list.1.transfer.net.1.bias", "pre_blocks_list.1.transfer.net.1.running_mean", "pre_blocks_list.1.transfer.net.1.running_var", "pre_blocks_list.1.operation.0.net1.0.weight", "pre_blocks_list.1.operation.0.net1.1.weight", "pre_blocks_list.1.operation.0.net1.1.bias", "pre_blocks_list.1.operation.0.net1.1.running_mean", "pre_blocks_list.1.operation.0.net1.1.running_var", "pre_blocks_list.1.operation.0.net2.0.weight", "pre_blocks_list.1.operation.0.net2.1.weight", "pre_blocks_list.1.operation.0.net2.1.bias", "pre_blocks_list.1.operation.0.net2.1.running_mean", "pre_blocks_list.1.operation.0.net2.1.running_var", "pre_blocks_list.1.operation.1.net1.0.weight", "pre_blocks_list.1.operation.1.net1.1.weight", "pre_blocks_list.1.operation.1.net1.1.bias", "pre_blocks_list.1.operation.1.net1.1.running_mean", "pre_blocks_list.1.operation.1.net1.1.running_var", "pre_blocks_list.1.operation.1.net2.0.weight", "pre_blocks_list.1.operation.1.net2.1.weight", "pre_blocks_list.1.operation.1.net2.1.bias", "pre_blocks_list.1.operation.1.net2.1.running_mean", "pre_blocks_list.1.operation.1.net2.1.running_var", "pre_blocks_list.2.transfer.net.0.weight", "pre_blocks_list.2.transfer.net.1.weight", "pre_blocks_list.2.transfer.net.1.bias", "pre_blocks_list.2.transfer.net.1.running_mean", "pre_blocks_list.2.transfer.net.1.running_var", "pre_blocks_list.2.operation.0.net1.0.weight", "pre_blocks_list.2.operation.0.net1.1.weight", "pre_blocks_list.2.operation.0.net1.1.bias", "pre_blocks_list.2.operation.0.net1.1.running_mean", "pre_blocks_list.2.operation.0.net1.1.running_var", "pre_blocks_list.2.operation.0.net2.0.weight", "pre_blocks_list.2.operation.0.net2.1.weight", "pre_blocks_list.2.operation.0.net2.1.bias", "pre_blocks_list.2.operation.0.net2.1.running_mean", "pre_blocks_list.2.operation.0.net2.1.running_var", "pre_blocks_list.2.operation.1.net1.0.weight", "pre_blocks_list.2.operation.1.net1.1.weight", "pre_blocks_list.2.operation.1.net1.1.bias", "pre_blocks_list.2.operation.1.net1.1.running_mean", "pre_blocks_list.2.operation.1.net1.1.running_var", "pre_blocks_list.2.operation.1.net2.0.weight", "pre_blocks_list.2.operation.1.net2.1.weight", "pre_blocks_list.2.operation.1.net2.1.bias", "pre_blocks_list.2.operation.1.net2.1.running_mean", "pre_blocks_list.2.operation.1.net2.1.running_var", "pre_blocks_list.3.transfer.net.0.weight", "pre_blocks_list.3.transfer.net.1.weight", "pre_blocks_list.3.transfer.net.1.bias", "pre_blocks_list.3.transfer.net.1.running_mean", "pre_blocks_list.3.transfer.net.1.running_var", "pre_blocks_list.3.operation.0.net1.0.weight", "pre_blocks_list.3.operation.0.net1.1.weight", "pre_blocks_list.3.operation.0.net1.1.bias", "pre_blocks_list.3.operation.0.net1.1.running_mean", "pre_blocks_list.3.operation.0.net1.1.running_var", "pre_blocks_list.3.operation.0.net2.0.weight", "pre_blocks_list.3.operation.0.net2.1.weight", "pre_blocks_list.3.operation.0.net2.1.bias", "pre_blocks_list.3.operation.0.net2.1.running_mean", "pre_blocks_list.3.operation.0.net2.1.running_var", "pre_blocks_list.3.operation.1.net1.0.weight", "pre_blocks_list.3.operation.1.net1.1.weight", "pre_blocks_list.3.operation.1.net1.1.bias", "pre_blocks_list.3.operation.1.net1.1.running_mean", "pre_blocks_list.3.operation.1.net1.1.running_var", "pre_blocks_list.3.operation.1.net2.0.weight", "pre_blocks_list.3.operation.1.net2.1.weight", "pre_blocks_list.3.operation.1.net2.1.bias", "pre_blocks_list.3.operation.1.net2.1.running_mean", "pre_blocks_list.3.operation.1.net2.1.running_var", "pos_blocks_list.0.operation.0.net1.0.weight", "pos_blocks_list.0.operation.0.net1.1.weight", "pos_blocks_list.0.operation.0.net1.1.bias", "pos_blocks_list.0.operation.0.net1.1.running_mean", "pos_blocks_list.0.operation.0.net1.1.running_var", "pos_blocks_list.0.operation.0.net2.0.weight", "pos_blocks_list.0.operation.0.net2.1.weight", "pos_blocks_list.0.operation.0.net2.1.bias", "pos_blocks_list.0.operation.0.net2.1.running_mean", "pos_blocks_list.0.operation.0.net2.1.running_var", "pos_blocks_list.0.operation.1.net1.0.weight", "pos_blocks_list.0.operation.1.net1.1.weight", "pos_blocks_list.0.operation.1.net1.1.bias", "pos_blocks_list.0.operation.1.net1.1.running_mean", "pos_blocks_list.0.operation.1.net1.1.running_var", "pos_blocks_list.0.operation.1.net2.0.weight", "pos_blocks_list.0.operation.1.net2.1.weight", "pos_blocks_list.0.operation.1.net2.1.bias", "pos_blocks_list.0.operation.1.net2.1.running_mean", "pos_blocks_list.0.operation.1.net2.1.running_var", "pos_blocks_list.1.operation.0.net1.0.weight", "pos_blocks_list.1.operation.0.net1.1.weight", "pos_blocks_list.1.operation.0.net1.1.bias", "pos_blocks_list.1.operation.0.net1.1.running_mean", "pos_blocks_list.1.operation.0.net1.1.running_var", "pos_blocks_list.1.operation.0.net2.0.weight", "pos_blocks_list.1.operation.0.net2.1.weight", "pos_blocks_list.1.operation.0.net2.1.bias", "pos_blocks_list.1.operation.0.net2.1.running_mean", "pos_blocks_list.1.operation.0.net2.1.running_var", "pos_blocks_list.1.operation.1.net1.0.weight", "pos_blocks_list.1.operation.1.net1.1.weight", "pos_blocks_list.1.operation.1.net1.1.bias", "pos_blocks_list.1.operation.1.net1.1.running_mean", "pos_blocks_list.1.operation.1.net1.1.running_var", "pos_blocks_list.1.operation.1.net2.0.weight", "pos_blocks_list.1.operation.1.net2.1.weight", "pos_blocks_list.1.operation.1.net2.1.bias", "pos_blocks_list.1.operation.1.net2.1.running_mean", "pos_blocks_list.1.operation.1.net2.1.running_var", "pos_blocks_list.2.operation.0.net1.0.weight", "pos_blocks_list.2.operation.0.net1.1.weight", "pos_blocks_list.2.operation.0.net1.1.bias", "pos_blocks_list.2.operation.0.net1.1.running_mean", "pos_blocks_list.2.operation.0.net1.1.running_var", "pos_blocks_list.2.operation.0.net2.0.weight", "pos_blocks_list.2.operation.0.net2.1.weight", "pos_blocks_list.2.operation.0.net2.1.bias", "pos_blocks_list.2.operation.0.net2.1.running_mean", "pos_blocks_list.2.operation.0.net2.1.running_var", "pos_blocks_list.2.operation.1.net1.0.weight", "pos_blocks_list.2.operation.1.net1.1.weight", "pos_blocks_list.2.operation.1.net1.1.bias", "pos_blocks_list.2.operation.1.net1.1.running_mean", "pos_blocks_list.2.operation.1.net1.1.running_var", "pos_blocks_list.2.operation.1.net2.0.weight", "pos_blocks_list.2.operation.1.net2.1.weight", "pos_blocks_list.2.operation.1.net2.1.bias", "pos_blocks_list.2.operation.1.net2.1.running_mean", "pos_blocks_list.2.operation.1.net2.1.running_var", "pos_blocks_list.3.operation.0.net1.0.weight", "pos_blocks_list.3.operation.0.net1.1.weight", "pos_blocks_list.3.operation.0.net1.1.bias", "pos_blocks_list.3.operation.0.net1.1.running_mean", "pos_blocks_list.3.operation.0.net1.1.running_var", "pos_blocks_list.3.operation.0.net2.0.weight", "pos_blocks_list.3.operation.0.net2.1.weight", "pos_blocks_list.3.operation.0.net2.1.bias", "pos_blocks_list.3.operation.0.net2.1.running_mean", "pos_blocks_list.3.operation.0.net2.1.running_var", "pos_blocks_list.3.operation.1.net1.0.weight", "pos_blocks_list.3.operation.1.net1.1.weight", "pos_blocks_list.3.operation.1.net1.1.bias", "pos_blocks_list.3.operation.1.net1.1.running_mean", "pos_blocks_list.3.operation.1.net1.1.running_var", "pos_blocks_list.3.operation.1.net2.0.weight", "pos_blocks_list.3.operation.1.net2.1.weight", "pos_blocks_list.3.operation.1.net2.1.bias", "pos_blocks_list.3.operation.1.net2.1.running_mean", "pos_blocks_list.3.operation.1.net2.1.running_var", "classifier.0.weight", "classifier.0.bias", "classifier.1.weight", "classifier.1.bias", "classifier.1.running_mean", "classifier.1.running_var", "classifier.4.weight", "classifier.4.bias", "classifier.5.weight", "classifier.5.bias", "classifier.5.running_mean", "classifier.5.running_var", "classifier.8.weight", "classifier.8.bias". 
	Unexpected key(s) in state_dict: "net", "epoch", "acc", "best_test_acc", "best_train_acc", "best_test_acc_avg", "best_train_acc_avg", "best_test_loss", "best_train_loss", "optimizer".

Would appreciate any help on how to solve this (if possible).
Thanks in advance!

Answer 1 · 2022-06-03T02:50:28.000Z

I used the following code for loading

if __name__ == '__main__':
    data = torch.rand(2, 3, 1024)
    print("===> testing pointMLP ...")
    model = pointMLP().load_state_dict(torch.load('PATH/best_checkpoint.pth', map_location=torch.device('cpu')))
    out = model(data)
    print(out.shape)

Answer 2 · 2022-06-03T06:29:39.000Z

@simon-at-hypothetic
Try this:
checkpoint = torch.load(checkpoint_path, map_location=torch.device('cpu'))
net.load_state_dict(checkpoint['net'])

parameters are saved in checkpoint['net'].

Answer 3 · 2022-06-03T06:30:13.000Z

For more details, please see: https://github.com/ma-xu/pointMLP-pytorch/blob/main/classification_ModelNet40/test.py

Answer 4 · 2022-06-03T15:55:21.000Z

Unfortunately, I still get the same error.

RuntimeError: Error(s) in loading state_dict for Model:
	Missing key(s) in state_dict: "embedding.net.0.weight", "embedding.net.1.weight", "embedding.net.1.bias", "embedding.net.1.running_mean", "embedding.net.1.running_var", "local_grouper_list.0.affine_alpha", "local_grouper_list.0.affine_beta", "local_grouper_list.1.affine_alpha", "local_grouper_list.1.affine_beta", "local_grouper_list.2.affine_alpha", "local_grouper_list.2.affine_beta", "local_grouper_list.3.affine_alpha", "local_grouper_list.3.affine_beta", "pre_blocks_list.0.transfer.net.0.weight", "pre_blocks_list.0.transfer.net.1.weight", "pre_blocks_list.0.transfer.net.1.bias", "pre_blocks_list.0.transfer.net.1.running_mean", "pre_blocks_list.0.transfer.net.1.running_var", "pre_blocks_list.0.operation.0.net1.0.weight", "pre_blocks_list.0.operation.0.net1.1.weight", "pre_blocks_list.0.operation.0.net1.1.bias", "pre_blocks_list.0.operation.0.net1.1.running_mean", "pre_blocks_list.0.operation.0.net1.1.running_var", "pre_blocks_list.0.operation.0.net2.0.weight", "pre_blocks_list.0.operation.0.net2.1.weight", "pre_blocks_list.0.operation.0.net2.1.bias", "pre_blocks_list.0.operation.0.net2.1.running_mean", "pre_blocks_list.0.operation.0.net2.1.running_var", "pre_blocks_list.0.operation.1.net1.0.weight", "pre_blocks_list.0.operation.1.net1.1.weight", "pre_blocks_list.0.operation.1.net1.1.bias", "pre_blocks_list.0.operation.1.net1.1.running_mean", "pre_blocks_list.0.operation.1.net1.1.running_var", "pre_blocks_list.0.operation.1.net2.0.weight", "pre_blocks_list.0.operation.1.net2.1.weight", "pre_blocks_list.0.operation.1.net2.1.bias", "pre_blocks_list.0.operation.1.net2.1.running_mean", "pre_blocks_list.0.operation.1.net2.1.running_var", "pre_blocks_list.1.transfer.net.0.weight", "pre_blocks_list.1.transfer.net.1.weight", "pre_blocks_list.1.transfer.net.1.bias", "pre_blocks_list.1.transfer.net.1.running_mean", "pre_blocks_list.1.transfer.net.1.running_var", "pre_blocks_list.1.operation.0.net1.0.weight", "pre_blocks_list.1.operation.0.net1.1.weight", "pre_blocks_list.1.operation.0.net1.1.bias", "pre_blocks_list.1.operation.0.net1.1.running_mean", "pre_blocks_list.1.operation.0.net1.1.running_var", "pre_blocks_list.1.operation.0.net2.0.weight", "pre_blocks_list.1.operation.0.net2.1.weight", "pre_blocks_list.1.operation.0.net2.1.bias", "pre_blocks_list.1.operation.0.net2.1.running_mean", "pre_blocks_list.1.operation.0.net2.1.running_var", "pre_blocks_list.1.operation.1.net1.0.weight", "pre_blocks_list.1.operation.1.net1.1.weight", "pre_blocks_list.1.operation.1.net1.1.bias", "pre_blocks_list.1.operation.1.net1.1.running_mean", "pre_blocks_list.1.operation.1.net1.1.running_var", "pre_blocks_list.1.operation.1.net2.0.weight", "pre_blocks_list.1.operation.1.net2.1.weight", "pre_blocks_list.1.operation.1.net2.1.bias", "pre_blocks_list.1.operation.1.net2.1.running_mean", "pre_blocks_list.1.operation.1.net2.1.running_var", "pre_blocks_list.2.transfer.net.0.weight", "pre_blocks_list.2.transfer.net.1.weight", "pre_blocks_list.2.transfer.net.1.bias", "pre_blocks_list.2.transfer.net.1.running_mean", "pre_blocks_list.2.transfer.net.1.running_var", "pre_blocks_list.2.operation.0.net1.0.weight", "pre_blocks_list.2.operation.0.net1.1.weight", "pre_blocks_list.2.operation.0.net1.1.bias", "pre_blocks_list.2.operation.0.net1.1.running_mean", "pre_blocks_list.2.operation.0.net1.1.running_var", "pre_blocks_list.2.operation.0.net2.0.weight", "pre_blocks_list.2.operation.0.net2.1.weight", "pre_blocks_list.2.operation.0.net2.1.bias", "pre_blocks_list.2.operation.0.net2.1.running_mean", "pre_blocks_list.2.operation.0.net2.1.running_var", "pre_blocks_list.2.operation.1.net1.0.weight", "pre_blocks_list.2.operation.1.net1.1.weight", "pre_blocks_list.2.operation.1.net1.1.bias", "pre_blocks_list.2.operation.1.net1.1.running_mean", "pre_blocks_list.2.operation.1.net1.1.running_var", "pre_blocks_list.2.operation.1.net2.0.weight", "pre_blocks_list.2.operation.1.net2.1.weight", "pre_blocks_list.2.operation.1.net2.1.bias", "pre_blocks_list.2.operation.1.net2.1.running_mean", "pre_blocks_list.2.operation.1.net2.1.running_var", "pre_blocks_list.3.transfer.net.0.weight", "pre_blocks_list.3.transfer.net.1.weight", "pre_blocks_list.3.transfer.net.1.bias", "pre_blocks_list.3.transfer.net.1.running_mean", "pre_blocks_list.3.transfer.net.1.running_var", "pre_blocks_list.3.operation.0.net1.0.weight", "pre_blocks_list.3.operation.0.net1.1.weight", "pre_blocks_list.3.operation.0.net1.1.bias", "pre_blocks_list.3.operation.0.net1.1.running_mean", "pre_blocks_list.3.operation.0.net1.1.running_var", "pre_blocks_list.3.operation.0.net2.0.weight", "pre_blocks_list.3.operation.0.net2.1.weight", "pre_blocks_list.3.operation.0.net2.1.bias", "pre_blocks_list.3.operation.0.net2.1.running_mean", "pre_blocks_list.3.operation.0.net2.1.running_var", "pre_blocks_list.3.operation.1.net1.0.weight", "pre_blocks_list.3.operation.1.net1.1.weight", "pre_blocks_list.3.operation.1.net1.1.bias", "pre_blocks_list.3.operation.1.net1.1.running_mean", "pre_blocks_list.3.operation.1.net1.1.running_var", "pre_blocks_list.3.operation.1.net2.0.weight", "pre_blocks_list.3.operation.1.net2.1.weight", "pre_blocks_list.3.operation.1.net2.1.bias", "pre_blocks_list.3.operation.1.net2.1.running_mean", "pre_blocks_list.3.operation.1.net2.1.running_var", "pos_blocks_list.0.operation.0.net1.0.weight", "pos_blocks_list.0.operation.0.net1.1.weight", "pos_blocks_list.0.operation.0.net1.1.bias", "pos_blocks_list.0.operation.0.net1.1.running_mean", "pos_blocks_list.0.operation.0.net1.1.running_var", "pos_blocks_list.0.operation.0.net2.0.weight", "pos_blocks_list.0.operation.0.net2.1.weight", "pos_blocks_list.0.operation.0.net2.1.bias", "pos_blocks_list.0.operation.0.net2.1.running_mean", "pos_blocks_list.0.operation.0.net2.1.running_var", "pos_blocks_list.0.operation.1.net1.0.weight", "pos_blocks_list.0.operation.1.net1.1.weight", "pos_blocks_list.0.operation.1.net1.1.bias", "pos_blocks_list.0.operation.1.net1.1.running_mean", "pos_blocks_list.0.operation.1.net1.1.running_var", "pos_blocks_list.0.operation.1.net2.0.weight", "pos_blocks_list.0.operation.1.net2.1.weight", "pos_blocks_list.0.operation.1.net2.1.bias", "pos_blocks_list.0.operation.1.net2.1.running_mean", "pos_blocks_list.0.operation.1.net2.1.running_var", "pos_blocks_list.1.operation.0.net1.0.weight", "pos_blocks_list.1.operation.0.net1.1.weight", "pos_blocks_list.1.operation.0.net1.1.bias", "pos_blocks_list.1.operation.0.net1.1.running_mean", "pos_blocks_list.1.operation.0.net1.1.running_var", "pos_blocks_list.1.operation.0.net2.0.weight", "pos_blocks_list.1.operation.0.net2.1.weight", "pos_blocks_list.1.operation.0.net2.1.bias", "pos_blocks_list.1.operation.0.net2.1.running_mean", "pos_blocks_list.1.operation.0.net2.1.running_var", "pos_blocks_list.1.operation.1.net1.0.weight", "pos_blocks_list.1.operation.1.net1.1.weight", "pos_blocks_list.1.operation.1.net1.1.bias", "pos_blocks_list.1.operation.1.net1.1.running_mean", "pos_blocks_list.1.operation.1.net1.1.running_var", "pos_blocks_list.1.operation.1.net2.0.weight", "pos_blocks_list.1.operation.1.net2.1.weight", "pos_blocks_list.1.operation.1.net2.1.bias", "pos_blocks_list.1.operation.1.net2.1.running_mean", "pos_blocks_list.1.operation.1.net2.1.running_var", "pos_blocks_list.2.operation.0.net1.0.weight", "pos_blocks_list.2.operation.0.net1.1.weight", "pos_blocks_list.2.operation.0.net1.1.bias", "pos_blocks_list.2.operation.0.net1.1.running_mean", "pos_blocks_list.2.operation.0.net1.1.running_var", "pos_blocks_list.2.operation.0.net2.0.weight", "pos_blocks_list.2.operation.0.net2.1.weight", "pos_blocks_list.2.operation.0.net2.1.bias", "pos_blocks_list.2.operation.0.net2.1.running_mean", "pos_blocks_list.2.operation.0.net2.1.running_var", "pos_blocks_list.2.operation.1.net1.0.weight", "pos_blocks_list.2.operation.1.net1.1.weight", "pos_blocks_list.2.operation.1.net1.1.bias", "pos_blocks_list.2.operation.1.net1.1.running_mean", "pos_blocks_list.2.operation.1.net1.1.running_var", "pos_blocks_list.2.operation.1.net2.0.weight", "pos_blocks_list.2.operation.1.net2.1.weight", "pos_blocks_list.2.operation.1.net2.1.bias", "pos_blocks_list.2.operation.1.net2.1.running_mean", "pos_blocks_list.2.operation.1.net2.1.running_var", "pos_blocks_list.3.operation.0.net1.0.weight", "pos_blocks_list.3.operation.0.net1.1.weight", "pos_blocks_list.3.operation.0.net1.1.bias", "pos_blocks_list.3.operation.0.net1.1.running_mean", "pos_blocks_list.3.operation.0.net1.1.running_var", "pos_blocks_list.3.operation.0.net2.0.weight", "pos_blocks_list.3.operation.0.net2.1.weight", "pos_blocks_list.3.operation.0.net2.1.bias", "pos_blocks_list.3.operation.0.net2.1.running_mean", "pos_blocks_list.3.operation.0.net2.1.running_var", "pos_blocks_list.3.operation.1.net1.0.weight", "pos_blocks_list.3.operation.1.net1.1.weight", "pos_blocks_list.3.operation.1.net1.1.bias", "pos_blocks_list.3.operation.1.net1.1.running_mean", "pos_blocks_list.3.operation.1.net1.1.running_var", "pos_blocks_list.3.operation.1.net2.0.weight", "pos_blocks_list.3.operation.1.net2.1.weight", "pos_blocks_list.3.operation.1.net2.1.bias", "pos_blocks_list.3.operation.1.net2.1.running_mean", "pos_blocks_list.3.operation.1.net2.1.running_var", "classifier.0.weight", "classifier.0.bias", "classifier.1.weight", "classifier.1.bias", "classifier.1.running_mean", "classifier.1.running_var", "classifier.4.weight", "classifier.4.bias", "classifier.5.weight", "classifier.5.bias", "classifier.5.running_mean", "classifier.5.running_var", "classifier.8.weight", "classifier.8.bias". 
	Unexpected key(s) in state_dict: "module.embedding.net.0.weight", "module.embedding.net.1.weight", "module.embedding.net.1.bias", "module.embedding.net.1.running_mean", "module.embedding.net.1.running_var", "module.embedding.net.1.num_batches_tracked", "module.local_grouper_list.0.affine_alpha", "module.local_grouper_list.0.affine_beta", "module.local_grouper_list.1.affine_alpha", "module.local_grouper_list.1.affine_beta", "module.local_grouper_list.2.affine_alpha", "module.local_grouper_list.2.affine_beta", "module.local_grouper_list.3.affine_alpha", "module.local_grouper_list.3.affine_beta", "module.pre_blocks_list.0.transfer.net.0.weight", "module.pre_blocks_list.0.transfer.net.1.weight", "module.pre_blocks_list.0.transfer.net.1.bias", "module.pre_blocks_list.0.transfer.net.1.running_mean", "module.pre_blocks_list.0.transfer.net.1.running_var", "module.pre_blocks_list.0.transfer.net.1.num_batches_tracked", "module.pre_blocks_list.0.operation.0.net1.0.weight", "module.pre_blocks_list.0.operation.0.net1.1.weight", "module.pre_blocks_list.0.operation.0.net1.1.bias", "module.pre_blocks_list.0.operation.0.net1.1.running_mean", "module.pre_blocks_list.0.operation.0.net1.1.running_var", "module.pre_blocks_list.0.operation.0.net1.1.num_batches_tracked", "module.pre_blocks_list.0.operation.0.net2.0.weight", "module.pre_blocks_list.0.operation.0.net2.1.weight", "module.pre_blocks_list.0.operation.0.net2.1.bias", "module.pre_blocks_list.0.operation.0.net2.1.running_mean", "module.pre_blocks_list.0.operation.0.net2.1.running_var", "module.pre_blocks_list.0.operation.0.net2.1.num_batches_tracked", "module.pre_blocks_list.0.operation.1.net1.0.weight", "module.pre_blocks_list.0.operation.1.net1.1.weight", "module.pre_blocks_list.0.operation.1.net1.1.bias", "module.pre_blocks_list.0.operation.1.net1.1.running_mean", "module.pre_blocks_list.0.operation.1.net1.1.running_var", "module.pre_blocks_list.0.operation.1.net1.1.num_batches_tracked", "module.pre_blocks_list.0.operation.1.net2.0.weight", "module.pre_blocks_list.0.operation.1.net2.1.weight", "module.pre_blocks_list.0.operation.1.net2.1.bias", "module.pre_blocks_list.0.operation.1.net2.1.running_mean", "module.pre_blocks_list.0.operation.1.net2.1.running_var", "module.pre_blocks_list.0.operation.1.net2.1.num_batches_tracked", "module.pre_blocks_list.1.transfer.net.0.weight", "module.pre_blocks_list.1.transfer.net.1.weight", "module.pre_blocks_list.1.transfer.net.1.bias", "module.pre_blocks_list.1.transfer.net.1.running_mean", "module.pre_blocks_list.1.transfer.net.1.running_var", "module.pre_blocks_list.1.transfer.net.1.num_batches_tracked", "module.pre_blocks_list.1.operation.0.net1.0.weight", "module.pre_blocks_list.1.operation.0.net1.1.weight", "module.pre_blocks_list.1.operation.0.net1.1.bias", "module.pre_blocks_list.1.operation.0.net1.1.running_mean", "module.pre_blocks_list.1.operation.0.net1.1.running_var", "module.pre_blocks_list.1.operation.0.net1.1.num_batches_tracked", "module.pre_blocks_list.1.operation.0.net2.0.weight", "module.pre_blocks_list.1.operation.0.net2.1.weight", "module.pre_blocks_list.1.operation.0.net2.1.bias", "module.pre_blocks_list.1.operation.0.net2.1.running_mean", "module.pre_blocks_list.1.operation.0.net2.1.running_var", "module.pre_blocks_list.1.operation.0.net2.1.num_batches_tracked", "module.pre_blocks_list.1.operation.1.net1.0.weight", "module.pre_blocks_list.1.operation.1.net1.1.weight", "module.pre_blocks_list.1.operation.1.net1.1.bias", "module.pre_blocks_list.1.operation.1.net1.1.running_mean", "module.pre_blocks_list.1.operation.1.net1.1.running_var", "module.pre_blocks_list.1.operation.1.net1.1.num_batches_tracked", "module.pre_blocks_list.1.operation.1.net2.0.weight", "module.pre_blocks_list.1.operation.1.net2.1.weight", "module.pre_blocks_list.1.operation.1.net2.1.bias", "module.pre_blocks_list.1.operation.1.net2.1.running_mean", "module.pre_blocks_list.1.operation.1.net2.1.running_var", "module.pre_blocks_list.1.operation.1.net2.1.num_batches_tracked", "module.pre_blocks_list.2.transfer.net.0.weight", "module.pre_blocks_list.2.transfer.net.1.weight", "module.pre_blocks_list.2.transfer.net.1.bias", "module.pre_blocks_list.2.transfer.net.1.running_mean", "module.pre_blocks_list.2.transfer.net.1.running_var", "module.pre_blocks_list.2.transfer.net.1.num_batches_tracked", "module.pre_blocks_list.2.operation.0.net1.0.weight", "module.pre_blocks_list.2.operation.0.net1.1.weight", "module.pre_blocks_list.2.operation.0.net1.1.bias", "module.pre_blocks_list.2.operation.0.net1.1.running_mean", "module.pre_blocks_list.2.operation.0.net1.1.running_var", "module.pre_blocks_list.2.operation.0.net1.1.num_batches_tracked", "module.pre_blocks_list.2.operation.0.net2.0.weight", "module.pre_blocks_list.2.operation.0.net2.1.weight", "module.pre_blocks_list.2.operation.0.net2.1.bias", "module.pre_blocks_list.2.operation.0.net2.1.running_mean", "module.pre_blocks_list.2.operation.0.net2.1.running_var", "module.pre_blocks_list.2.operation.0.net2.1.num_batches_tracked", "module.pre_blocks_list.2.operation.1.net1.0.weight", "module.pre_blocks_list.2.operation.1.net1.1.weight", "module.pre_blocks_list.2.operation.1.net1.1.bias", "module.pre_blocks_list.2.operation.1.net1.1.running_mean", "module.pre_blocks_list.2.operation.1.net1.1.running_var", "module.pre_blocks_list.2.operation.1.net1.1.num_batches_tracked", "module.pre_blocks_list.2.operation.1.net2.0.weight", "module.pre_blocks_list.2.operation.1.net2.1.weight", "module.pre_blocks_list.2.operation.1.net2.1.bias", "module.pre_blocks_list.2.operation.1.net2.1.running_mean", "module.pre_blocks_list.2.operation.1.net2.1.running_var", "module.pre_blocks_list.2.operation.1.net2.1.num_batches_tracked", "module.pre_blocks_list.3.transfer.net.0.weight", "module.pre_blocks_list.3.transfer.net.1.weight", "module.pre_blocks_list.3.transfer.net.1.bias", "module.pre_blocks_list.3.transfer.net.1.running_mean", "module.pre_blocks_list.3.transfer.net.1.running_var", "module.pre_blocks_list.3.transfer.net.1.num_batches_tracked", "module.pre_blocks_list.3.operation.0.net1.0.weight", "module.pre_blocks_list.3.operation.0.net1.1.weight", "module.pre_blocks_list.3.operation.0.net1.1.bias", "module.pre_blocks_list.3.operation.0.net1.1.running_mean", "module.pre_blocks_list.3.operation.0.net1.1.running_var", "module.pre_blocks_list.3.operation.0.net1.1.num_batches_tracked", "module.pre_blocks_list.3.operation.0.net2.0.weight", "module.pre_blocks_list.3.operation.0.net2.1.weight", "module.pre_blocks_list.3.operation.0.net2.1.bias", "module.pre_blocks_list.3.operation.0.net2.1.running_mean", "module.pre_blocks_list.3.operation.0.net2.1.running_var", "module.pre_blocks_list.3.operation.0.net2.1.num_batches_tracked", "module.pre_blocks_list.3.operation.1.net1.0.weight", "module.pre_blocks_list.3.operation.1.net1.1.weight", "module.pre_blocks_list.3.operation.1.net1.1.bias", "module.pre_blocks_list.3.operation.1.net1.1.running_mean", "module.pre_blocks_list.3.operation.1.net1.1.running_var", "module.pre_blocks_list.3.operation.1.net1.1.num_batches_tracked", "module.pre_blocks_list.3.operation.1.net2.0.weight", "module.pre_blocks_list.3.operation.1.net2.1.weight", "module.pre_blocks_list.3.operation.1.net2.1.bias", "module.pre_blocks_list.3.operation.1.net2.1.running_mean", "module.pre_blocks_list.3.operation.1.net2.1.running_var", "module.pre_blocks_list.3.operation.1.net2.1.num_batches_tracked", "module.pos_blocks_list.0.operation.0.net1.0.weight", "module.pos_blocks_list.0.operation.0.net1.1.weight", "module.pos_blocks_list.0.operation.0.net1.1.bias", "module.pos_blocks_list.0.operation.0.net1.1.running_mean", "module.pos_blocks_list.0.operation.0.net1.1.running_var", "module.pos_blocks_list.0.operation.0.net1.1.num_batches_tracked", "module.pos_blocks_list.0.operation.0.net2.0.weight", "module.pos_blocks_list.0.operation.0.net2.1.weight", "module.pos_blocks_list.0.operation.0.net2.1.bias", "module.pos_blocks_list.0.operation.0.net2.1.running_mean", "module.pos_blocks_list.0.operation.0.net2.1.running_var", "module.pos_blocks_list.0.operation.0.net2.1.num_batches_tracked", "module.pos_blocks_list.0.operation.1.net1.0.weight", "module.pos_blocks_list.0.operation.1.net1.1.weight", "module.pos_blocks_list.0.operation.1.net1.1.bias", "module.pos_blocks_list.0.operation.1.net1.1.running_mean", "module.pos_blocks_list.0.operation.1.net1.1.running_var", "module.pos_blocks_list.0.operation.1.net1.1.num_batches_tracked", "module.pos_blocks_list.0.operation.1.net2.0.weight", "module.pos_blocks_list.0.operation.1.net2.1.weight", "module.pos_blocks_list.0.operation.1.net2.1.bias", "module.pos_blocks_list.0.operation.1.net2.1.running_mean", "module.pos_blocks_list.0.operation.1.net2.1.running_var", "module.pos_blocks_list.0.operation.1.net2.1.num_batches_tracked", "module.pos_blocks_list.1.operation.0.net1.0.weight", "module.pos_blocks_list.1.operation.0.net1.1.weight", "module.pos_blocks_list.1.operation.0.net1.1.bias", "module.pos_blocks_list.1.operation.0.net1.1.running_mean", "module.pos_blocks_list.1.operation.0.net1.1.running_var", "module.pos_blocks_list.1.operation.0.net1.1.num_batches_tracked", "module.pos_blocks_list.1.operation.0.net2.0.weight", "module.pos_blocks_list.1.operation.0.net2.1.weight", "module.pos_blocks_list.1.operation.0.net2.1.bias", "module.pos_blocks_list.1.operation.0.net2.1.running_mean", "module.pos_blocks_list.1.operation.0.net2.1.running_var", "module.pos_blocks_list.1.operation.0.net2.1.num_batches_tracked", "module.pos_blocks_list.1.operation.1.net1.0.weight", "module.pos_blocks_list.1.operation.1.net1.1.weight", "module.pos_blocks_list.1.operation.1.net1.1.bias", "module.pos_blocks_list.1.operation.1.net1.1.running_mean", "module.pos_blocks_list.1.operation.1.net1.1.running_var", "module.pos_blocks_list.1.operation.1.net1.1.num_batches_tracked", "module.pos_blocks_list.1.operation.1.net2.0.weight", "module.pos_blocks_list.1.operation.1.net2.1.weight", "module.pos_blocks_list.1.operation.1.net2.1.bias", "module.pos_blocks_list.1.operation.1.net2.1.running_mean", "module.pos_blocks_list.1.operation.1.net2.1.running_var", "module.pos_blocks_list.1.operation.1.net2.1.num_batches_tracked", "module.pos_blocks_list.2.operation.0.net1.0.weight", "module.pos_blocks_list.2.operation.0.net1.1.weight", "module.pos_blocks_list.2.operation.0.net1.1.bias", "module.pos_blocks_list.2.operation.0.net1.1.running_mean", "module.pos_blocks_list.2.operation.0.net1.1.running_var", "module.pos_blocks_list.2.operation.0.net1.1.num_batches_tracked", "module.pos_blocks_list.2.operation.0.net2.0.weight", "module.pos_blocks_list.2.operation.0.net2.1.weight", "module.pos_blocks_list.2.operation.0.net2.1.bias", "module.pos_blocks_list.2.operation.0.net2.1.running_mean", "module.pos_blocks_list.2.operation.0.net2.1.running_var", "module.pos_blocks_list.2.operation.0.net2.1.num_batches_tracked", "module.pos_blocks_list.2.operation.1.net1.0.weight", "module.pos_blocks_list.2.operation.1.net1.1.weight", "module.pos_blocks_list.2.operation.1.net1.1.bias", "module.pos_blocks_list.2.operation.1.net1.1.running_mean", "module.pos_blocks_list.2.operation.1.net1.1.running_var", "module.pos_blocks_list.2.operation.1.net1.1.num_batches_tracked", "module.pos_blocks_list.2.operation.1.net2.0.weight", "module.pos_blocks_list.2.operation.1.net2.1.weight", "module.pos_blocks_list.2.operation.1.net2.1.bias", "module.pos_blocks_list.2.operation.1.net2.1.running_mean", "module.pos_blocks_list.2.operation.1.net2.1.running_var", "module.pos_blocks_list.2.operation.1.net2.1.num_batches_tracked", "module.pos_blocks_list.3.operation.0.net1.0.weight", "module.pos_blocks_list.3.operation.0.net1.1.weight", "module.pos_blocks_list.3.operation.0.net1.1.bias", "module.pos_blocks_list.3.operation.0.net1.1.running_mean", "module.pos_blocks_list.3.operation.0.net1.1.running_var", "module.pos_blocks_list.3.operation.0.net1.1.num_batches_tracked", "module.pos_blocks_list.3.operation.0.net2.0.weight", "module.pos_blocks_list.3.operation.0.net2.1.weight", "module.pos_blocks_list.3.operation.0.net2.1.bias", "module.pos_blocks_list.3.operation.0.net2.1.running_mean", "module.pos_blocks_list.3.operation.0.net2.1.running_var", "module.pos_blocks_list.3.operation.0.net2.1.num_batches_tracked", "module.pos_blocks_list.3.operation.1.net1.0.weight", "module.pos_blocks_list.3.operation.1.net1.1.weight", "module.pos_blocks_list.3.operation.1.net1.1.bias", "module.pos_blocks_list.3.operation.1.net1.1.running_mean", "module.pos_blocks_list.3.operation.1.net1.1.running_var", "module.pos_blocks_list.3.operation.1.net1.1.num_batches_tracked", "module.pos_blocks_list.3.operation.1.net2.0.weight", "module.pos_blocks_list.3.operation.1.net2.1.weight", "module.pos_blocks_list.3.operation.1.net2.1.bias", "module.pos_blocks_list.3.operation.1.net2.1.running_mean", "module.pos_blocks_list.3.operation.1.net2.1.running_var", "module.pos_blocks_list.3.operation.1.net2.1.num_batches_tracked", "module.classifier.0.weight", "module.classifier.0.bias", "module.classifier.1.weight", "module.classifier.1.bias", "module.classifier.1.running_mean", "module.classifier.1.running_var", "module.classifier.1.num_batches_tracked", "module.classifier.4.weight", "module.classifier.4.bias", "module.classifier.5.weight", "module.classifier.5.bias", "module.classifier.5.running_mean", "module.classifier.5.running_var", "module.classifier.5.num_batches_tracked", "module.classifier.8.weight", "module.classifier.8.bias".

Answer 5 · 2022-06-03T17:07:31.000Z

@simon-at-hypothetic
if name == 'main':
import os
data = torch.rand(2, 3, 1024)
print("===> testing pointMLP ...")
model = pointMLP()
checkpoint_path = os.path.join("{path}", 'best_checkpoint.pth')
checkpoint = torch.load(checkpoint_path, map_location=torch.device('cpu'))
model = torch.nn.DataParallel(model)
model.load_state_dict(checkpoint['net'])
out = model(data)
print(out.shape)

You just need to replace the path. The problem is caused by the torch.nn.DataParallel, which introduce "module." before the model name.

Answer 6 · 2022-06-03T17:11:53.000Z

Oh yeah that makes sense, it worked!
Thanks so much for your help, really appreciate it.