dqbd/tiktoken

gpt-3.5-turbo-instruct support

Closed this issue · 2 comments

for now, I'm using text-davinci-003 for model encoding, but not sure if that's right with this new model series

I think it's the newer cl100k_base not the older model type

I think it's the newer cl100k_base not the older model type

Which model would that be?

Is this right?

encodingForModel("gpt-3.5-turbo");