Eddiewdy

Eddiewdy's Stars

• vllm-project/vllm

  A high-throughput and memory-efficient inference and serving engine for LLMs

  Language:Python43.5k3607.7k6.6k

• hpcaitech/ColossalAI

  Making large AI models cheaper, faster and more accessible

  Language:Python40.7k3921.7k4.5k

• microsoft/DeepSpeed

  DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

  Language:Python36.5k3482.9k4.2k

• Tencent/ncnn

  ncnn is a high-performance neural network inference framework optimized for the mobile platform

  Language:C++21.2k5713.6k4.2k

• chenzomi12/AISystem

  AISystem 主要是指AI系统，包括AI芯片、AI编译器、AI推理和训练框架等AI全栈底层技术

  Language:Jupyter Notebook13.1k167451.9k

• NVIDIA/Megatron-LM

  Ongoing research training transformer models at scale

  Language:Python12k1689272.7k

• RUCAIBox/LLMSurvey

  The official GitHub page for the survey paper "A Survey of Large Language Models".

  Language:Python11.3k16365881

• NVIDIA/cutlass

  CUDA Templates for Linear Algebra Subroutines

  Language:C++7.2k1121.3k1.2k

• bitsandbytes-foundation/bitsandbytes

  Accessible large language models via k-bit quantization for PyTorch.

  Language:Python6.9k511.1k681

• kungfu-origin/kungfu

  Kungfu Trader

  Language:C++3.5k287571.1k

• qwopqwop200/GPTQ-for-LLaMa

  4 bits quantization of LLaMA using GPTQ

  Language:Python3k42218461

• kvcache-ai/Mooncake

  Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

  Language:C++3k3090193

• zjhellofss/KuiperInfer

  校招、秋招、春招、实习好项目！带你从零实现一个高性能的深度学习推理库，支持大模型 llama2 、Unet、Yolov5、Resnet等模型的推理。Implement a high-performance deep learning inference library step by step

  Language:C++2.8k2628318

• S-LoRA/S-LoRA

  S-LoRA: Serving Thousands of Concurrent LoRA Adapters

  Language:Python1.8k2439107

• OpenPPL/ppq

  PPL Quantization Tool (PPQ) is a powerful offline neural network quantization tool.

  Language:Python1.7k16240249

• NVIDIA/trt-samples-for-hackathon-cn

  Simple samples for TensorRT programming

  Language:Python1.6k2192346

• OpenPPL/ppl.nn

  A primitive library for neural network

  Language:C++1.3k36121217

• rsd-devel/rsd

  RSD: RISC-V Out-of-Order Superscalar Processor

  Language:SystemVerilog1.1k3346103

• pigirons/cpufp

  A CPU tool for benchmarking the peak of floating points

  Language:Assembly5311915131

• Jack47/hack-SysML

  The road to hack SysML and become an system expert

  Language:Emacs Lisp47834259

• Bruce-Lee-LY/cuda_hgemm

  Several optimization methods of half-precision general matrix multiplication (HGEMM) using tensor core with WMMA API and MMA PTX instruction.

  Language:Cuda37951477

• Eddie-Wang1120/Professional-CUDA-C-Programming-Code-and-Notes

  CUDA C 编程权威指南代码实现 包含了书上第二章到第八章的大部分代码实现和作者笔记，全由作者本人手动实现，难免有错误的地方，请大家谨慎参考，非常欢迎对错误的指正。 如果有帮助的话请Star一下，对作者帮助很大，谢谢！

  Language:Cuda3252022

• ifromeast/cuda_learning

  learning how CUDA works

  Language:Cuda2263327

• OpenPPL/ppl.llm.kernel.cuda

  Language:C++1454726

• CMU-SAFARI/Pythia

  A customizable hardware prefetching framework using online reinforcement learning as described in the MICRO 2021 paper by Bera et al. (https://arxiv.org/pdf/2109.12021.pdf).

  Language:C++13181145

• reed-lau/cute-gemm

  Language:C++1132533

• HuPengsheet/use-ncnn

  NCNN的代码学习，各种小Demo。

  Language:C++103145

• YuanchengFang/dlsys_solution

  Homework solutions for CMU 10-414/714 – Deep Learning Systems: Algorithms and Implementation

  Language:Python43114

• zhang-tlgg/HPC-Lab

  HPC-Lab for High Performance Computing course, 2023 Spring , Tsinghua Universit. 高性能计算导论 @ THU.

  Language:C++22100

• OpenPPL/ppl.kernel.cpu

  Language:C++174412