App is hillariously difficult to use
kpu opened this issue · 1 comments
kpu commented
I know it's just for internal testing but...
$ app/bergamot
Aborted (core dumped)
$ app/bergamot --help
Bergamot CLI
Usage: app/bergamot [OPTIONS]
Options:
-h,--help Print this help message and exit
--build-info Print build-info and exit
--version Print version-info and exit
--model-config-paths TEXT ...
Configuration files list, can be used for pivoting multiple models or multiple model workflows
--cpu-threads UINT Workers to form translation backend
--cache-size UINT Number of entries to store in cache.
--log-level TEXT Set verbosity level of logging: trace, debug, info, warn, err(or), critical, off
$ app/bergamot --model-config-paths ~/.config/translateLocally/ende.student.base-1660853034/config.intgemm8bitalpha.yml --log-level trace
[2022-08-21 18:58:43] [data] Loading SentencePiece vocabulary from buffer
[2022-08-21 18:58:43] Missing list of protected prefixes for sentence splitting. Set with --ssplit-prefix-file.
[2022-08-21 18:58:43] Error: Fatal: max-length-break > mini-batch-words will lead to sentences longer than what can fit in a batch.
[2022-08-21 18:58:43] Error: Aborted from marian::bergamot::BatchingPool::BatchingPool(marian::Ptr<marian::Options>) in /home/testing/bergamot-translator/src/translator/batching_pool.cpp:24
[CALL STACK]
[0x55c4526d7812] + 0x14f812
[0x55c4526c2702] + 0x13a702
[0x55c452656a57] + 0xcea57
[0x7f7b83c4e34a] + 0x2934a
[0x7f7b83c4e3fc] __libc_start_main + 0x7c
[0x55c452676bc1] + 0xeebc1
Aborted (core dumped)
$ app/bergamot --model-config-paths ~/.config/translateLocally/ende.student.base-1660853034/config.intgemm8bitalpha.yml --log-level trace --ssplit-prefix-file ~/preprocess/moses/share/nonbreaking_prefixes/nonbreaking_prefix.en
The following arguments were not expected: /home/testing/preprocess/moses/share/nonbreaking_prefixes/nonbreaking_prefix.en --ssplit-prefix-file
Run with --help for more information.
sanderfoobar commented
FYI: I forked this project over at https://github.com/kroketio/kotki to enhance the developer experience, usage should be easier.
Edit: Linux only