stanfordnlp/GloVe

Overflow in "overflow_threshold" (src/cooccur.c) when using 256G of memory

florath opened this issue · 0 comments

There is an overflow in the src/cooccur.c file: when using 256G of memory, the 'int' of the 'overflow_threshold' (line 294) runs into an overflow which results in some strange actions (starting to create thousands of files).

./build/cooccur -memory 128.0 -vocab-file [...]
[....]
overflow_threshold [1216907370]

but

./build/cooccur -memory 256.0 -vocab-file [...]
[....]
overflow_threshold [-1861152525]