The purpose of code "lm_labels[lm_labels[:, :] == self.tokenizer.pad_token_id] = -100 "

[shumuha]

Hi，

I'm trying to reimplement your work, and i'm curious about the following code:
lm_labels[lm_labels[:, :] == self.tokenizer.pad_token_id] = -100 (main.py, Line 109)

what's the purpose of this?