helloyongyang

helloyongyang's Stars

• DefTruth/CUDA-Learn-Notes

  🎉CUDA/C++ 笔记 / 大模型手撕CUDA / 技术博客，更新随缘: flash_attn、sgemm、sgemv、warp reduce、block reduce、dot product、elementwise、softmax、layernorm、rmsnorm、hist etc.

  Language:Cuda1.1k104

• ModelTC/llmc

  This is the official PyTorch implementation of "LLMC: Benchmarking Large Language Model Quantization with a Versatile Compression Toolkit".

  Language:Python21124

• ModelTC/msbench

  A tool for model sparse based on torch.fx

  Language:Python71

• NVIDIA/CUDALibrarySamples

  CUDA Library Samples

  Language:Cuda1.5k308

• HeKun-NVIDIA/TensorRT-Developer_Guide_in_Chinese

  20554

• liguodongiot/llm-action

  本项目旨在分享大模型相关技术原理以及实战经验。

  Language:HTML8.8k863

• Tongyi-EconML/FinQwen

  FinQwen: 致力于构建一个开放、稳定、高质量的金融大模型项目，基于大模型搭建金融场景智能问答系统，利用开源开放来促进「AI+金融」。

  Language:Jupyter Notebook23927

• zjunlp/LLMAgentPapers

  Must-read Papers on LLM Agents.

  1.6k85

• liucongg/ChatGLM-Finetuning

  基于ChatGLM-6B、ChatGLM2-6B、ChatGLM3-6B模型，进行下游具体任务微调，涉及Freeze、Lora、P-tuning、全参微调等

  Language:Python2.6k290

• srush/GPU-Puzzles

  Solve puzzles. Learn CUDA.

  Language:Jupyter Notebook5.6k329

• DefTruth/Awesome-LLM-Inference

  📖A curated list of Awesome LLM Inference Paper with codes, TensorRT-LLM, vLLM, streaming-llm, AWQ, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.

  2.3k154

• HuangOwen/Awesome-LLM-Compression

  Awesome LLM compression research papers and tools.

  1k63

• OpenGVLab/OmniQuant

  [ICLR2024 spotlight] OmniQuant is a simple and powerful quantization technique for LLMs.

  Language:Python65950

• ModelTC/Dipoorlet

  Offline Quantization Tools for Deploy.

  Language:Python10915

• fpgaminer/GPTQ-triton

  GPTQ inference Triton kernel

  Language:Jupyter Notebook27221

• mbehm/transformers

  🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

  Language:Python1314

• THUDM/ChatGLM2-6B

  ChatGLM2-6B: An Open Bilingual Chat LLM | 开源双语对话语言模型

  Language:Python15.7k1.8k

• agrechnev/trt-cpp-min

  TensorRT 7 C++ (almost) minimal examples

  Language:C++755

• dgSPARSE/dgSPARSE-Lib

  PyTorch-Based Fast and Efficient Processing for Various Machine Learning Applications with Diverse Sparsity

  Language:Cuda9626

• CompVis/stable-diffusion

  A latent text-to-image diffusion model

  Language:Jupyter Notebook67.3k10.1k

• OpenPPL/ppq

  PPL Quantization Tool (PPQ) is a powerful offline neural network quantization tool.

  Language:Python1.5k228

• chenyaofo/pytorch-cifar-models

  Pretrained models on CIFAR10/100 in PyTorch

  Language:Python29951

• bearpaw/pytorch-classification

  Classification with PyTorch.

  Language:Python1.7k562

• qfgaohao/pytorch-ssd

  MobileNetV1, MobileNetV2, VGG based SSD/SSD-lite implementation in Pytorch 1.0 / Pytorch 0.4. Out-of-box support for retraining on Open Images dataset. ONNX and Caffe2 support. Experiment Ideas like CoordConv.

  Language:Python1.4k528

• houqb/ssdlite-pytorch-mobilenext

  A PyTorch implementation of SSDLite on COCO

  Language:Python8421

• yhenon/pytorch-retinanet

  Pytorch implementation of RetinaNet object detection.

  Language:Python2.1k663

• multimodallearning/pytorch-mask-rcnn

  Language:Python2k556

• HKUST-Aerial-Robotics/FUEL

  An Efficient Framework for Fast UAV Exploration

  Language:C++897190

• bzantium/pytorch-admm-pruning

  Prune DNN using Alternating Direction Method of Multipliers (ADMM)

  Language:Python9619

• HobbitLong/RepDistiller

  [ICLR 2020] Contrastive Representation Distillation (CRD), and benchmark of recent knowledge distillation methods

  Language:Python2.1k394