/qbaraqahira

Official PyTorch implementation of Q-BaRA and QA-HiRA

Primary LanguagePython

qbara_qahira

To be implemented! Coming soon!

Installation

Change the bnb.py in your peft path(python path/peft/tuners/lora/bnb.py) with the new one. Change the layer.py in your peft path(python path/peft/tuners/lora/layer.py) with the new one.

Acknowledgements

Our code is based on QLoRA