This repo contains the code for "Feature-based Low-Rank Compression of Large Language Models via Bayesian Optimization"(https://arxiv.org/abs/2405.10616)
pip install -r requirement.txt
bash run.sh
bash run_posttrain.sh
You can download the checkpoints for the model from here