lajanugen/zeshel

In training model, where mention position is indicated?

izuna385 opened this issue · 0 comments

Thanks for uploading codes for Zero-shot EL, I'm very interested in this work.
Currently I'm reading codes but can't find where mention position is indicated.
(In the original paper, written as

[Ms], [Me] are special tokens to tag the mention.

)

https://github.com/lajanugen/zeshel/blob/master/create_training_data.py#L351 indicates [CLS] and [SEP] for concatenating mention-contexts and candidate documents.
I can't find codes for inverting [Ms] and [Me].

If you'd know something about this, I'd appreciate it much.
Thanks.