paperswithcode/galai

Anyone know the easiest way to run Galactica?

d3netxer opened this issue · 1 comments

Either locally or using a cloud-based service. I want to demo it using the least amount of effort possible : )

I used oobabooga text generation UI to run the 1.3b model. I selected transformers from the drop-down and it works fine. I'm sure you can run the bigger models too if you have enough VRAM