top_k and repetition_penalty
Closed this issue · 3 comments
Qubitium commented
Can top_k and repetition_penalty be added? Thanks.
deep-diver commented
It works in batch mode
Qubitium commented
@deep-diver top_k and repetition_penalty are not applicable for batch mode?
deep-diver commented
it works now. but batch mode is deprecated for now.