/VocabTuner

Automatically tune number of BPE-merge operations for translating subword units

Primary LanguagePythonGNU Lesser General Public License v3.0LGPL-3.0

VocabTuner

Optimize number of BPE merge operations for translating subword units

Dependencies

Python Packages

Software

External Tools