Tlntin/Qwen-TensorRT-LLM

Qwen-72B-Chat-Int4 killed

Closed this issue · 2 comments

Hukongtao commented
Qwen-72B-Chat-Int4 killed
Hukongtao commented

image
image

CPU和GPU资源都是充足的。报错应该是在构建模型的时候：
image

teis-e commented

How did you fix this?