How to generate words beyond the vocabulary ?

[gaoisbest]

As the paper says in the end of Section 2.2 State Generator

Note that due to Eq (2), our model is able to generate words even if they are not pre-defined in the vocabulary.

but as the code shows, p_context_ptr = torch.zeros(p_vocab.size()), does that mean it restrict the words must be in pre-defined vocabulary ?

For example, the vocabulary size is 100, but we have a word id in story is 103.

Thanks a lot

[jasonwu0731]

Hi, please check issue #15 for an explanation.