Pure Go implementation of OpenAI's tiktoken tokenizer
Primary LanguageGoMIT LicenseMIT
No one’s star this repository yet.