qwopqwop200/GPTQ-for-LLaMa

Why does the model quantization prompt KILLED at the end?

g558800 opened this issue · 2 comments

Why does the model quantization prompt KILLED at the end?
无标题

It's a RAM issue, try to increase the RAM size, or add a memory swap

Resolved. thanks