Getting Input validation error

[cmosguy]

Keep getting this error message when the llm-vscode extension is running.

Input validation error: `inputs` tokens + `max_new_tokens` must be <= 2048. Given: 3474 `inputs` tokens and 60 `max_new_tokens`

[McPatate]

What did you set the context window to?

[cmosguy]

I set the context window to 8096 or something like that... I guess I have to set to smaller amount - like 2048 or should I set it to 2048-60?

[McPatate]

It depends on the model, check the context window of the model. But yes generally it should be set to context_window - max_new_tokens

[github-actions]

This issue is stale because it has been open for 30 days with no activity.

[McPatate]

Closing for now, feel free to re-open if you're still facing an issue

[hossamrizk]

Any updates?