/peft-llama-enhancer

This repository provides a minimal implementation of various PEFT methods for fine-tuning LLaMA. It's designed to be simple, but effective.

Primary LanguagePythonApache License 2.0Apache-2.0

PEFT LLaMa Enhancer\n\n
\n peft-llama-enhancer\n
\n\nThis repository provides a minimal implementation of various PEFT (Pipelined Execution of Finite Tasks) methods for fine-tuning LLaMA. It's designed to be simple, yet effective.\n\n# Supported methods\n\n| Method | Status | Paper |\n| --- | --- | --- |\n| (IA)3 | ✅ | arxiv.org/abs/2205.05638 |\n\nMaintained by herla172.