Issues
- 3
OSX support
#11 opened by maximzubkov - 3
- 0
why use byte not str while in path (Windows)
#7 opened by lyksdu - 1
PreprocessingMetadata enhancement
#2 opened by hlibbabii - 0
By default use end-of-full-token character (</t>) instead of token boundaries (<w>, </w>) for all kinds of pre-processing for consistency
#3 opened by hlibbabii - 0
Create PreppedTokenSequence class to incapsulate getting full tokens from subtokens
#4 opened by hlibbabii - 0
Enhance `ParsedToken` hierarchy
#5 opened by hlibbabii