niieani/gpt-tokenizer

Add support for `gpt-3.5-turbo-0613` and `gpt-3.5-turbo-16k-0613`

Closed this issue · 2 comments

nilsreichardt commented

As listed in the README.md, there is no support for the new models:

  • gpt-3.5-turbo-0613
  • gpt-3.5-turbo-16k-0613
niieani commented

AFAIK all GPT-3.5 models use the same cl100k_base encodings.

github-actions commented

🎉 This issue has been resolved in version 2.2.1 🎉

The release is available on:

Your semantic-release bot 📦🚀