/my_pefty_llama

Minimal implementation of multiple PEFT methods for LLaMA fine-tuning

Primary LanguagePythonApache License 2.0Apache-2.0

My PEFTy LLaMa

my_pefty_llama

Minimal implementations of multiple PEFT methods for LLaMA fine-tuning.

Supported methods

Method Status Paper
(IA)3 ✅ arxiv.org/abs/2205.05638