locuslab/wanda

Change sparsity rates

Closed this issue · 0 comments

I used unstructured prune with sparsity rate of 0.8 instead of 0.5 for llama2-7B, but the effect was not good,even worse than 0.5. What could be causing this? Why did you only consider sparsity rate of 0.5 in your experiments? Thasks a lot.