Closed this issue 3 months ago · 1 comments
how can i use multi gpu for inference? Thank you
Currently, we do not support multi-GPU inference, but we will release the code for multi-GPU inference in the future.