chinese tokenizer

[thebruuu]

Hello
Do you have a tokenizer model to share?

Thank you for your precious efforts

[ysykzheng]

sorry, not pre-training model. you can google other chinese tokenizer implement or train by yourself.