KeyError encountered when using gpt-3.5-turbo-16k

[michilu]

I attempted to use the gpt-3.5-turbo-16k model as GPT-4 is not yet available. However, I encountered a KeyError when trying to access self.model_max_tokens[self.model]. It seems that gpt-3.5-turbo-16k is not included in the model_max_tokens dictionary. Could you please update the list to include this model?

Error Details:

File "chatgpt_prompt_wrapper/chatgpt/chatgpt.py", line 118, in set_model
    self.tokens_limit = self.model_max_tokens[self.model] - 1
                        ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^
KeyError: 'gpt-3.5-turbo-16k'

chatgpt-prompt-wrapper/src/chatgpt_prompt_wrapper/chatgpt/chatgpt.py

Lines 88 to 107 in 41b2e8c

	# Ref: https://platform.openai.com/docs/models/overview
	self.model_max_tokens = {
	"gpt-4": 8192,
	"gpt-4-0314": 8192,
	"gpt-4-32k": 32768,
	"gpt-4-32k-0314": 32768,
	"gpt-3.5-turbo": 4096,
	"gpt-3.5-turbo-0301": 4096,
	}
	# prices / 1K tokens in USD, (Prompt, Completion)
	# Ref: https://openai.com/pricing#language-models
	self.prices = {
	"gpt-4": (0.03, 0.06),
	"gpt-4-0314": (0.03, 0.06),
	"gpt-4-32k": (0.06, 0.12),
	"gpt-4-32k-0314": (0.06, 0.12),
	"gpt-3.5-turbo": (0.002, 0.002),
	"gpt-3.5-turbo-0301": (0.002, 0.002),
	}

[rcmdnk]

Thanks for making the issue.

At v0.0.13,
gpt-4-0613, gpt-4-32k-0613, gpt-3.5-turbo-0613, gpt-3.5-turbo-16k and gp-3.5-turbo-16k-0613 are added.

In addition, from v0.0.13, you can add (or change) new models by adding model_max_tokens and prices definitions to the configuration file:

[global.model_max_tokens]
"gpt-3.5-turbo-16k" = 16384

[global.prices]
"gpt-3.5-turbo-16k" = [0.003, 0.004]

See README for details.

But anyway, I'd appreciate it if you make an issue when you find the new model not listed in the default configuration.

[michilu]

That's great! Your quick response and continuous improvement of the system are greatly appreciated.

Now, it seems that version v0.0.13 has not been published to PyPI yet. https://pypi.org/project/chatgpt-prompt-wrapper/#history Due to this, I encountered an error when trying to install it using brew install.

[rcmdnk]

Ah, sorry. The package was updated correctly, and you should be able to install it now.