mistralai/mistral-inference

speed up inference?

xxyp opened this issue · 0 comments

xxyp commented

employing Codestral-22B-v0.1 by Mistral-inference, the speed seems slow. there any methods to speed up the inference ?