/kortok

The code and models for "An Empirical Study of Tokenization Strategies for Various Korean NLP Tasks" (AACL-IJCNLP 2020)

Primary LanguagePythonApache License 2.0Apache-2.0

Stargazers