In training model, where mention position is indicated?
izuna385 opened this issue · 0 comments
izuna385 commented
Thanks for uploading codes for Zero-shot EL, I'm very interested in this work.
Currently I'm reading codes but can't find where mention position is indicated.
(In the original paper, written as
[Ms], [Me] are special tokens to tag the mention.
)
https://github.com/lajanugen/zeshel/blob/master/create_training_data.py#L351 indicates [CLS] and [SEP] for concatenating mention-contexts and candidate documents.
I can't find codes for inverting [Ms] and [Me].
If you'd know something about this, I'd appreciate it much.
Thanks.