报错Some modules are dispatched on the CPU or the disk. Make sure you have enough GPU RAM to fit

[gabrielpondc]

Some modules are dispatched on the CPU or the disk. Make sure you have enough GPU RAM to fit
是GPU不够吗
if "cpu" in device_map_without_lm_head.values() or "disk" in device_map_without_lm_head.values():
-> 3246 raise ValueError(
3247 """
3248 Some modules are dispatched on the CPU or the disk. Make sure you have enough GPU RAM to fit
...
these modules in 32-bit, you need to set load_in_8bit_fp32_cpu_offload=True and pass a custom
device_map to from_pretrained. Check
https://huggingface.co/docs/transformers/main/en/main_classes/quantization#offload-between-cpu-and-gpu
for more details.

[zhao1iang]

看起来是GPT 显存不够了