(Do not give GPU time to rest!) Start inferencing next piece as long as current piece is out from the model, leave saving a separated process (for cpu).
Closed this issue · 0 comments
CarlGao4 commented
(Do not give GPU time to rest!) Start inferencing next piece as long as current piece is out from the model, leave saving a separated process (for cpu).