maodoudou168

maodoudou168's Stars

• intel/neural-compressor

  SOTA low-bit LLM quantization (INT8/FP8/INT4/FP4/NF4) & sparsity; leading model compression techniques on TensorFlow, PyTorch, and ONNX Runtime

  Language:Python2.1k251

• AUTOMATIC1111/stable-diffusion-webui

  Stable Diffusion web UI

  Language:Python137k26k

• TheLastBen/fast-stable-diffusion

  fast-stable-diffusion + DreamBooth

  Language:Python7.4k1.3k

• vllm-project/vllm

  A high-throughput and memory-efficient inference and serving engine for LLMs

  Language:Python23.8k3.4k

• horseee/DeepCache

  [CVPR 2024] DeepCache: Accelerating Diffusion Models for Free

  Language:Python71232

• Dao-AILab/flash-attention

  Fast and memory-efficient exact attention

  Language:Python12.6k1.1k

• mli/paper-reading

  深度学习经典、新论文逐段精读

  25.2k2.3k

• ai-forever/Kandinsky-2

  Kandinsky 2 — multilingual text2image latent diffusion model

  Language:Jupyter Notebook2.7k306

• nbasyl/LLM-FP4

  The official implementation of the EMNLP 2023 paper LLM-FP4

  Language:Python1457

• SqueezeAILab/SqueezeLLM

  [ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization

  Language:Python60838

• HuangOwen/Awesome-LLM-Compression

  Awesome LLM compression research papers and tools.

  91454

• OpenGVLab/OmniQuant

  [ICLR2024 spotlight] OmniQuant is a simple and powerful quantization technique for LLMs.

  Language:Python62949

• mit-han-lab/llm-awq

  [MLSys 2024 Best Paper Award] AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration

  Language:Python2.2k159

• AutoGPTQ/AutoGPTQ

  An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.

  Language:Python4.2k433

• mit-han-lab/smoothquant

  [ICML 2023] SmoothQuant: Accurate and Efficient Post-Training Quantization for Large Language Models

  Language:Python1.1k129

• liguodongiot/llm-action

  本项目旨在分享大模型相关技术原理以及实战经验。

  Language:HTML8.1k796

• siliconflow/onediff

  OneDiff: An out-of-the-box acceleration library for diffusion models.

  Language:Python1.5k89

• RahulSChand/gpu_poor

  Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization

  Language:JavaScript73135

• bitsandbytes-foundation/bitsandbytes

  Accessible large language models via k-bit quantization for PyTorch.

  Language:Python5.8k590

• pytorch/PiPPy

  Pipeline Parallelism for PyTorch

  Language:Python67781

• Lisennlp/distributed_train_pytorch

  pytorch分布式训练，支持多机多卡，单机多卡。

  Language:Python368

• hpcaitech/ColossalAI

  Making large AI models cheaper, faster and more accessible

  Language:Python38.4k4.3k

• microsoft/DeepSpeedExamples

  Example models using DeepSpeed

  Language:Python5.9k997

• moon-hotel/BertWithPretrained

  An implementation of the BERT model and its related downstream tasks based on the PyTorch framework

  Language:Python547106

• qwopqwop200/GPTQ-for-LLaMa

  4 bits quantization of LLaMA using GPTQ

  Language:Python3k454

• dafish-ai/NTU-Machine-learning

  **大学李宏毅老师机器学习

  Language:Jupyter Notebook932377

• lcdevelop/MachineLearningCourse

  机器学习精简入门教程

  832262

• dafish-ai/MachineLearning-GaoYang

  主要是高扬《白话机器学习》的相关内容，作业以及推荐资料汇总

  2210

• triton-inference-server/backend

  Common source, scripts and utilities for creating Triton backends.

  Language:C++27481

• cog-isa/deep-path

  Language:Python138