koaning opened this issue 3 years ago · 0 comments
With bytepair, how do you set the vocab size?
Hyphens might be a nice balance.