what is the meaning of '.' in glove pretrained vector?
BodyCSoulN opened this issue · 7 comments
BodyCSoulN commented
AngledLuffa commented
you mean in the text or in the numbers? what's an example?
BodyCSoulN commented
you mean in the text or in the numbers? what's an example?
As you can see in the figure, there are two '.' in line 52344, what is the meaning of it?
AngledLuffa commented
Ah... is it possible this is a tokenization issue? Each column should have 301 entries, I believe, 1 word and 300 numbers. In this case, do you now have multiple "word" entries followed by 300 numbers?
BodyCSoulN commented
Oh, I am sorry. I left out the previous word and now one line represents a 300-dimensional vector. My question is: why does a '.' appear where a number should appear?
AngledLuffa commented
No idea, honestly. If it's now lined up correctly with 300 numbers at the
end of each line, you're saying one of them is just "." instead of a number?
BodyCSoulN commented
AngledLuffa commented
Thanks for following up!