/LLaMA-8bit-LoRA

Repository for training a LoRA for the LLaMA model on HuggingFace with 8-bit quantization. Research only.

Primary LanguagePython

Chat LLaMA

8bit-LoRA

Repository for training a LoRA for the LLaMA model on HuggingFace with 8-bit quantization. Research only.


👉 Join our Discord Server for updates, support & collaboration


Dataset creation, training, weight merging, and quantization instructions are in the docs.

Check out our trained LoRAs on HuggingFace

Anthropic's HH