/demo-huginn-13b-gptq

This is a Huginn-13B-GPTQ model starter template from Banana.dev that allows on-demand serverless GPU inference.

Primary LanguagePython

Stargazers

No one’s star this repository yet.