/sentencepiece

Unsupervised text tokenizer for Neural Network-based text generation.

Primary LanguageC++Apache License 2.0Apache-2.0

Watchers