/ia3

An implementation of IA3.

Primary LanguagePythonMIT LicenseMIT

IA3

An implementation of IA3 from Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context Learning in PyTorch.

Installation

Install with pip.

pip install git+https://github.com/oelin/ia3

Citations

@misc{liu2022fewshot,
      title={Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context Learning},
      author={Haokun Liu and Derek Tam and Mohammed Muqeeth and Jay Mohta and Tenghao Huang and Mohit Bansal and Colin Raffel},
      year={2022},
      eprint={2205.05638},
      archivePrefix={arXiv},
      primaryClass={cs.LG}
}