[Help] 请问api.py中的max_length参数具体指的是什么length
zhengyangyong opened this issue · 0 comments
zhengyangyong commented
Is there an existing issue for this?
- I have searched the existing issues
Current Behavior
想确定是如下哪一种:
- 输入(Token)长度
- 输出(Token)长度
- 上下文长度
- 输入+输出长度
现象如图:
这个参数,如果设置得比输入小会报错:Input length of input_ids is 2183, but max_length
is set to 500. This can lead to unexpected behavior. You should consider increasing max_new_tokens
从这个表现可以看出这个参数是限制输入长度的,但是很多模型此参数是 限制输出长度 的,如果限制输出长度,又应该如何设置
Expected Behavior
无
Steps To Reproduce
无
Environment
无
Anything else?
无