jiajunsun68

jiajunsun68's Stars

• binary-husky/gpt_academic

  为GPT/GLM等LLM大语言模型提供实用化交互接口，特别优化论文阅读/润色/写作体验，模块化设计，支持自定义快捷按钮&函数插件，支持Python和C++等项目剖析&自译解功能，PDF/LaTex论文翻译&总结功能，支持并行问询多种LLM模型，支持chatglm3等本地模型。接入通义千问, deepseekcoder, 讯飞星火, 文心一言, llama2, rwkv, claude2, moss等。

  Language:Python66.8k2831.7k8.2k

• microsoft/BitNet

  Official inference framework for 1-bit LLMs

  Language:C++12.6k13297879

• SJTU-IPADS/PowerInfer

  High-speed Large Language Model Serving on PCs with Consumer-grade GPUs

  Language:C++8k78172418

• microsoft/LLMLingua

  [EMNLP'23, ACL'24] To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.

  Language:Python4.8k34134268

• open-mmlab/mmpretrain

  OpenMMLab Pre-training Toolbox and Benchmark

  Language:Python3.5k307861.1k

• IST-DASLab/gptq

  Code for the ICLR 2023 paper "GPTQ: Accurate Post-training Quantization of Generative Pretrained Transformers".

  Language:Python2k2950160

• HuangOwen/Awesome-LLM-Compression

  Awesome LLM compression research papers and tools.

  1.3k42686

• Vahe1994/AQLM

  Official Pytorch repository for Extreme Compression of Large Language Models via Additive Quantization https://arxiv.org/pdf/2401.06118.pdf and PV-Tuning: Beyond Straight-Through Estimation for Extreme LLM Compression https://arxiv.org/abs/2405.14852

  Language:Python1.2k19102182

• luanshiyinyang/FacialExpressionRecognition

  人脸识别之表情识别项目相关源码

  Language:Python775540161

• locuslab/wanda

  A simple and effective LLM pruning approach.

  Language:Python70096595

• microsoft/TransformerCompression

  For releasing code related to compression methods for transformers, accompanying our publications

  Language:Python392115043

• NVlabs/Taylor_pruning

  Pruning Neural Networks with Taylor criterion in Pytorch

  Language:Python31517567

• Aaronhuang-778/BiLLM

  (ICML 2024) BiLLM: Pushing the Limit of Post-Training Quantization for LLMs

  Language:Python20461814

• hahnyuan/PB-LLM

  PB-LLM: Partially Binarized Large Language Models

  Language:Python1483810

• AIoT-MLSys-Lab/SVD-LLM

  Official Code for "SVD-LLM: Truncation-aware Singular Value Decomposition for Large Language Model Compression"

  Language:Python1097208

• VILA-Lab/GBLM-Pruner

  Are gradient information useful for pruning of LLMs?

  Language:Python41328

• cjyaras/deep-lora-transformers

  Compressible Dynamics in Deep Overparameterized Low-Rank Learning & Adaptation (ICML'24 Oral)

  Language:Python13200

• Dereck0602/Bolaco

  Language:Python9110

• saintslab/bmrs-structured-pruning

  Code release for the paper "BMRS: Bayesian Model Reduction for Structured Pruning"

  Language:Python3210