LiMa-cas

Pinned Repositories

• BiLLM

  (ICML 2024) BiLLM: Pushing the Limit of Post-Training Quantization for LLMs

  Language:Python20461814

• AutoAWQ

  AutoAWQ implements the AWQ algorithm for 4-bit quantization with a 2x speedup during inference. Documentation:

  Language:Python1.9k15429229

• quip-sharp

  Language:Python513126844

• flute

  Fast Matrix Multiplications for Lookup Table-Quantized LLMs

  Language:Cuda2134128

• llmc

  [EMNLP 2024 Industry Track] This is the official PyTorch implementation of "LLMC: Benchmarking Large Language Model Quantization with a Versatile Compression Toolkit".

  Language:Python375104743

• EfficientQAT

  EfficientQAT: Efficient Quantization-Aware Training for Large Language Models

  Language:Python23542518

• SqueezeLLM

  [ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization

  Language:Python667182843

• Llama3.1-Finetuning

  对llama3进行全参微调、lora微调以及qlora微调。

  Language:Python1703816

• AQLM

  Official Pytorch repository for Extreme Compression of Large Language Models via Additive Quantization https://arxiv.org/pdf/2401.06118.pdf and PV-Tuning: Beyond Straight-Through Estimation for Extreme LLM Compression https://arxiv.org/abs/2405.14852

  Language:Python1.2k19102182

• SpQR

  Language:Python535192543

LiMa-cas's Repositories