kaisugi/gpt4_vocab_list
Vocabulary list of GPT-4o (o200k_base) and GPT-4/GPT-3.5 (cl100k_base) tokenizers. Special tokens are excluded.
Stargazers
- andrea-superCalifornia
- AWKohlerBotflow.io
- brandcoOmaha, NE
- christopherwoodall
- Coldog2333The University of Tokyo
- congyingxia
- cs50victorwashington
- Cur519
- cybortI will be always collecting before 'everything went down'.
- d-cs@YuLife-LTD
- dlxj
- gglin001
- H-Pastry
- hsyoung
- IlyaRiceThailand, Chiangmai
- iwa2ki
- jannickglFriedrich-Alexander-Universität Erlangen
- jarroddavis68@tinyBigGAMES
- JeffCarpenterCanada
- justinhjTreasure Data
- karmi@cesko-digital
- kennDot Product AI
- kevalkamani
- kirikei4
- Lexuss-D
- mannybecerraHumanity
- nukezie
- oganm@PavlidisLab, UBC
- opvexeSingapore
- qq547276542Seed, @Bytedance
- sancyzuo
- scissorstailSeoul, South Korea
- steffens21Massachusetts
- stelamanova
- whitneyjmorgan
- YuchenHui22314