nlpyang/hiersumm

how to load spm9998_3.model file?

LGDEMO opened this issue · 1 comments

Dear Mr. Liu,

I'm studying your paper “Hierarchical Transformers for Multi-Document Summarization” and code, and I'm a new learner in this task. Recently, I wanna use your code to run my task which language is Chinese. Now, I have a question and need your help. In your code, there is a file named spm9998_3.model, but I do not konw how to load it and the contents in it. Could you tell me how to load this file?

Hi, @LGDEMO

In the README file, there is a link to download the vocabulary.

The sentencepiece vocab file is at: https://drive.google.com/open?id=1zbUILFWrgIeLEzSP93Mz5JkdVwVPY9Bf

This is the spm9998_3.model. So you can put the path in the command or set VOCAB_PATH then in command just change to $VOCAB_PATH