A JavaScript port of OpenAI's CLIP byte-pair-encoding tokenizer
Primary LanguageJavaScriptMIT LicenseMIT