/gpt-tokenizer

JavaScript BPE Tokenizer Encoder Decoder for OpenAI's GPT-2 / GPT-3 / GPT-4

Primary LanguageTypeScriptMIT LicenseMIT

No issues in this repository yet.