saving large outputs
Closed this issue · 1 comments
mhbodell commented
Trying to save output (e) from "largeish" dynamic model with: e.save(file_name) generate error code:
OverflowError: cannot serialize a bytes object larger than 4 GiB
Suggested solution: change line 108 in probabilistic-word-embeddings/probabilistic_word_embeddings/embeddings.py to "pickle.dump(d, f, protocol = 4)"
Python 3.7.6
Ubuntu 20.04.5 LTS