microsoft/ProphetNet

Unable to load the GENIE model

CSerxy opened this issue · 2 comments

CSerxy commented

Hi GENIE authors @lzh0525 @qiweizhen ,

Thanks for your excellent work. However, I found it hard to load your models. When I tried to do the inference on XSum or cnndm from your fine-tuned models. I got below errors:

RuntimeError: Error(s) in loading state_dict for CrossAttention_Diffusion_LM:
Unexpected key(s) in state_dict: "passage_encoder.embeddings.position_ids".

from Line model.load_state_dict(model_saved_state.model_dict) in ProphetNet/GENIE/Genie_Generate.py file.

I wonder if this relates to the PyTorch version I am using. Since I was able to load your model months ago, but cannot do it now. I kind of forgetting the version I used and didn't succeed to get the correct ones.

Also, would it be better to clarify upload your version in a requirement.txt file?

Many thanks!