How to optimize GPU usage?
deepak-newzera opened this issue · 0 comments
deepak-newzera commented
I am running the model on a batch of 500 articles and it takes around 10 to 15 GB of GPU memory.
Is there a way to optimize the GPU usage?
deepak-newzera opened this issue · 0 comments
I am running the model on a batch of 500 articles and it takes around 10 to 15 GB of GPU memory.
Is there a way to optimize the GPU usage?