vicgalle/gpt-j-api

Is there a way to get it working on a GPU server?

JialiuXu opened this issue · 2 comments

JialiuXu commented
Is there a way to get it working on a GPU server?
vicgalle commented

Sorry, without modifications the code from this repo is only compatible with TPUs.

JialiuXu commented

Thanks for your reply. I modified the code but got some VRAM issues, not clear the min RAM requirement of this model

Thanks for publishing this awesome API