Issues
- 4
WIN11 make build error: it said there is no dictionary target/release/libtokenizers.a
#26 opened by GinWithoutA - 3
- 2
segfault running example main.go
#16 opened by jaybinks - 1
cannot find -ltokenizers
#24 opened by Doloxetine - 1
memory issues when using tokenizers
#19 opened by homily707 - 7
invalid argument when running example/main.go
#20 opened by lianoid - 1
suport for offset mapping?
#22 opened by xuxiaoxia96 - 2
Performance regression
#14 opened by daulet - 1
panic: invalid argument
#17 opened by wuchaowei2012 - 2
example/main.go run error
#11 opened by Crisescode - 3
Thread safety issue
#13 opened by RJKeevil - 1
encode return tokens
#2 opened by 1407010218