opvexe/gpt4_vocab_list
Vocabulary list of GPT-4/GPT-3.5 tokenizer (cl100k_base). Special tokens are excluded.
Watchers
No one’s watching this repository yet.
Vocabulary list of GPT-4/GPT-3.5 tokenizer (cl100k_base). Special tokens are excluded.
No one’s watching this repository yet.