Invalid max_tokens selections for /gpt ask
Kav-K opened this issue · 0 comments
Kav-K commented
gpt-ask with older models seem to send a request where the max tokens are set to 4096, this is wrong, max tokens should either be omitted for these older models or just set to MODEL_MAX_TOKENS - CURRENT_TOKENS