About CUDA out of memory
Opened this issue · 0 comments
Ai-ZL commented
When I try the quantization step in this code, it cannot continue to run. An error occurs: CUDA out of memory. What can I do to solve this issue in the quantization step. Are there any parameters I can change? Thank you so much!