A PHP implementation of OpenAI's BPE tokenizer tiktoken.
Primary LanguagePHPMIT LicenseMIT
No issues in this repository yet.