/Fine-tuning-Llama-3-with-PyTorch-FSDP-and-Q-Lora

Efficiently fine-tune Llama 3 with PyTorch FSDP and Q-Lora

Primary LanguageJupyter NotebookMIT LicenseMIT

Fine-tuning-Llama-3-with-PyTorch-FSDP-and-Q-Lora

Efficiently fine-tune Llama 3 with PyTorch FSDP and Q-Lora