FMInference/FlexLLMGen

interesting you can crop 65b

seoeaa opened this issue 2 years ago · 0 comments

seoeaa commented 2 years ago

interesting you can crop 65b https://neuralmagic.com/blog/sparsegpt-remove-100-billion-parameters-for-free/