hitachi-nlp/compare-ja-tokenizer

How do different tokenizers perform on downstream tasks in scriptio continua languages?: A case study in Japanese - ACL SRW 2023

PythonNOASSERTION