niieani/gpt-tokenizer

最近官方更新了GPT3.5-16K的模型，请问计算方式跟gpt-3.5-turbo是一样的吗

Closed this issue · 1 comments

xiaoqixiaoqi1113 commented
最近官方更新了GPT3.5-16K的模型，请问计算方式跟gpt-3.5-turbo是一样的吗
niieani commented

yes, AFAIK all gpt-3.5 models use the same tokenizer