lovit/soynlp

tokenizer refactoring

lovit opened this issue · 0 comments

lovit commented
  • CLI 기능 제공 (train/tokenize)
  • _tokenizer_builder.py 제거
  • enhance #87