glample/fastBPE

Verbose mode

villmow opened this issue · 1 comments

Hi, nice work first of all!
Even though the output while loading the codes and vocab files can be helpful, I'd prefer it to be toggled by a verbose commandline parameter. Otherwise you can't directly use the stout while using the python module.

Thats the output:

Loading vocabulary from bpe.30000.vocab ...
Read 1258523173 words (30708 unique) from vocabulary file.
Loading codes from bpe.30000.codes ...

Ah ok, I see its printed to stderr. It works in my use case, but anyways I'd rather not have the information printed.