/gpt4_vocab_list

Vocabulary list of GPT-4/GPT-3.5 tokenizer (cl100k_base). Special tokens are excluded.

Watchers

No one’s watching this repository yet.