Question about the method to calculate the score

Question

yipliu opened this issue 3 years ago · 4 comments

Hi Zhang Lei,

Does the following code prevent the model from predicting the token contained in the input sentence?

score = score * mask2 + (-1e6)*(1-mask2)

Thanks!

Answer 1 · 2021-08-29T12:52:15.000Z

Yes. The word you are looking for that you don't know can not appear in your words.

Answer 2 · 2021-08-30T07:32:40.000Z

Hi Zhang Lei,

I wonder if I could ask you a question. How do you distinguish between NLG and NLU?

Answer 3 · 2021-08-30T15:29:21.000Z

Whether a new text is generated?