This repo contains the codes for our work “Failures Pave the Way: Enhancing Large Language Models through Tuning-free Rule Accumulation” (EMNLP 2023).
The required package can be installed by running the following command.
pip install -r requirements.txt
For all experiments, please download the data from their repos (Big-Bench and TweetEval).
The downloaded data are placed in the data
folder. Here is the example of downloading Big-Bench.
cd data
git clone https://github.com/google/BIG-bench
Please modify the openai key in the main.py
.
The scripts
folder contains code to reproduce our experiments.
For example, to run experiments on BBQ-Lite
, run the following code:
bash scripts/run_bbq.sh # run experiments on bbq-lite
Thank you for your interest in our work!
Please feel free to ask about any questions about the algorithms, codes, as well as problems encountered in running them so that we can make it clearer and better. You can either create an issue in the github repo or contact us at YangZeyuan2020@gmail.com.
@misc{yang2023failures,
title={Failures Pave the Way: Enhancing Large Language Models through Tuning-free Rule Accumulation},
author={Zeyuan Yang and Peng Li and Yang Liu},
year={2023},
eprint={2310.15746},
archivePrefix={arXiv},
primaryClass={cs.CL}
}
TRAN
is licensed under the terms of the MIT license. See LICENSE for more details.