ymcui/Chinese-BERT-wwm

求教：为什么词语要对应多个mask？

fangwc opened this issue · 3 comments

fangwc commented

mask 过程中， 现在虽然是词语会被同时mask掉， 但是比如一个词语2个字符现在对应2个mask， 为什么不是词语就是对应一个mask 即使有多个字符？ 求教

ymcui commented

如果两个字符对应一个mask，那预测的时候预测什么呢？预测空间，即词表是以字符（WordPiece级别）构成的。

stale commented

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

stale commented

Closing the issue, since no updates observed. Feel free to re-open if you need any further assistance.