Change sparsity rates
Closed this issue · 0 comments
Lexlum commented
I used unstructured prune with sparsity rate of 0.8 instead of 0.5 for llama2-7B, but the effect was not good,even worse than 0.5. What could be causing this? Why did you only consider sparsity rate of 0.5 in your experiments? Thasks a lot.