/easytoken

Tokenizer is an independent Open Source, Natural Language Processing python library which implements a tokenizer to create token from Both Sentence and Paragraph.

Primary LanguagePythonMIT LicenseMIT

Stargazers