/gotoke

simple tokenizer with some rudimentary analysis in go

Primary LanguageGo

Simple tokenizer to determine the top N words in a given document