The purpose of code "lm_labels[lm_labels[:, :] == self.tokenizer.pad_token_id] = -100 "
shumuha opened this issue · 0 comments
shumuha commented
Hi,
I'm trying to reimplement your work, and i'm curious about the following code:
lm_labels[lm_labels[:, :] == self.tokenizer.pad_token_id] = -100
(main.py, Line 109)
what's the purpose of this?