google-research/electra

about tagging task

LastRyan opened this issue · 0 comments

tagging_task.py,

line 132,

if len(words_to_tokens) + len(input_ids) + 1 > self.config.max_seq_length:
to
if len(word_tokens) + len(input_ids) + 1 > self.config.max_seq_length:
?