/demo-dolphin-llama2-7b-gptq

This is a Dolphin-Llama2-7B-GPTQ model starter template from Banana.dev that allows on-demand serverless GPU inference.

Primary LanguagePython

Stargazers

No one’s star this repository yet.