SqueezeAILab

SqueezeAI is part of Berkeley AI Research Lab at UC Berkeley focused on AI Systems research.

Pinned Repositories

KVQuant
KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization
Language:Python274 13 1323
LLM2LLM
[ACL 2024] LLM2LLM: Boosting LLMs with Novel Iterative Data Enhancement
Language:Python138 6 610
LLMCompiler
[ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling
Language:Python1.4k 19 6102
open_source_projects
Open Source Projects from Pallas Lab
16 3 02
SqueezeLLM
[ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization
Language:Python626 17 2742
TinyAgent
TinyAgent: Function Calling at the Edge!
Language:Python96 6 215

SqueezeAILab's Repositories

SqueezeAILab/LLMCompiler
[ICML 2024] LLMCompiler: An LLM Compiler for Parallel Function Calling
Language:Python1.4k 19 6102
SqueezeAILab/SqueezeLLM
[ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization
Language:Python626 17 2742
SqueezeAILab/KVQuant
KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization
Language:Python274 13 1323
SqueezeAILab/LLM2LLM
[ACL 2024] LLM2LLM: Boosting LLMs with Novel Iterative Data Enhancement
Language:Python138 6 610
SqueezeAILab/TinyAgent
TinyAgent: Function Calling at the Edge!
Language:Python96 6 215
SqueezeAILab/open_source_projects
Open Source Projects from Pallas Lab
16 3 02