SherrySwift

Pinned Repositories

• Atom

  [MLSys'24] Atom: Low-bit Quantization for Efficient and Accurate LLM Serving

  Language:Cuda286102025

• H2O

  [NeurIPS'23] H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models.

  Language:Python41353951

• LESS

  Language:Python48121

• DuQuant

  [NeurIPS 2024 Oral🔥] DuQuant: Distributing Outliers via Dual Transformation Makes Stronger Quantized LLMs.

  Language:Python1362169

• deepcompressor

  Model Compression Toolbox for Large Language Models and Diffusion Models

  Language:Python29993423

• qserve

  QServe: W4A8KV4 Quantization and System Co-design for Efficient LLM Serving

  Language:Python47884028

• KVQuant

  [NeurIPS 2024] KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization

  Language:Python324121729

SherrySwift's Repositories