/bpeasy

Fast bare-bones BPE for modern tokenizer training

Primary LanguagePythonMIT LicenseMIT

Stargazers