llm-compression

There are 7 repositories under llm-compression topic.

horseee/Awesome-Efficient-LLM
A curated list for Efficient Large Language Models
Language:Python940 37 172
pprp/Pruner-Zero
Evolving Symbolic Pruning Metric from scratch
Language:Python50 3 24
Picovoice/llm-compression-benchmark
LLM Compression Benchmark
Language:Python12 6 0
VITA-Group/llm-kick
[ICLR 2024] Jaiswal, A., Gan, Z., Du, X., Zhang, B., Wang, Z., & Yang, Y. Compressing llms: The truth is rarely pure and never simple.
Language:Python9 12 12
Picovoice/serverless-picollm
LLM Inference on AWS Lambda
Language:Python7
GongCheng1919/bias-compensation
[CAAI AIR'24] Minimize Quantization Output Error with Bias Compensation
Language:Python5 1 20
bupt-ai-club/llm-compression-papers
papers of llm compression
3 0 00