chatglm2 GPU版本的int4、int8量化模型预测结果异常
Closed this issue · 1 comments
itfish1990 commented
chenqy4933 commented
maybe there is a bug in an early commit， now it is ok in the main branch.
Closed this issue · 1 comments
maybe there is a bug in an early commit， now it is ok in the main branch.