/llm_finetuning

Convenient wrapper for fine-tuning and inference of Large Language Models (LLMs) with several quantization techniques (GTPQ, bitsandbytes)

Primary LanguagePythonApache License 2.0Apache-2.0

Issues