About Multiprocessing
Opened this issue · 3 comments
Hi, I met some difficulties about multiprocessing. When the num_processes is changed to more than 1, the assignment of tasks among the workers has something wrong. Do you have any idea about this issue?
I don't think this is a good question since there are no details in it.
I don't think this is a good question since there are no details in it.
I'm sorry for the unclear description. The problem is that if the num_processes is set as more than 1, the training process won't stop when the trained word percent (global_word_count.value/vocab.word_count) is 100%. In normal circumstances, the training is finished when it is 100%.
@JIANAN17 I think this bug is caused by the readline() code, I think your corpus is contains only one line. For more information, please chat in my issue #9 (comment)