/GPTQ-finetune

train a GPTQ quantised LLM with a local or hosted custon dataset using PEFT (parameter efficient fine tuning) and/or run inference with and without the model adapter

Primary LanguagePython

Stargazers

No one’s star this repository yet.