X-PLUG/mPLUG-Owl

RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda:2 and cuda:0! (when checking argument for argument weight in method wrapper_CUDA__cudnn_convolution)

wanghanyang123 opened this issue · 0 comments

多卡设备运行 Quick Start Code 时报错,修改 device 设置单卡可以。但是单卡显存太小(T4卡),只能 8bit 或者 4bit ,请问怎么可以调整成多卡且默认float16运行吗?