JackWeiw

JackWeiw's Stars

• chenzomi12/AISystem

  AISystem 主要是指AI系统，包括AI芯片、AI编译器、AI推理和训练框架等AI全栈底层技术

  Language:Jupyter Notebook11k1.6k

• DeepLink-org/deeplink.framework

  Language:Python5928

• huggingface/optimum-benchmark

  🏋️ A unified multi-backend utility for benchmarking Transformers, Timm, PEFT, Diffusers and Sentence-Transformers with full support of Optimum's hardware optimizations & quantization schemes.

  Language:Python24845

• yinuotxie/Efficient-LLM-Inferencing-on-GPUs

  Penn CIS 5650 (GPU Programming and Architecture) Final Project

  Language:C++233

• IST-DASLab/marlin

  FP16xINT4 LLM inference kernel that can achieve near-ideal ~4x speedups up to medium batchsizes of 16-32 tokens.

  Language:Python60445

• BBuf/how-to-optim-algorithm-in-cuda

  how to optimize some algorithm in cuda.

  Language:Cuda1.6k128

• leimao/CUDA-GEMM-Optimization

  CUDA Matrix Multiplication Optimization

  Language:Cuda13511

• SJTU-IPADS/PowerInfer

  High-speed Large Language Model Serving on PCs with Consumer-grade GPUs

  Language:C++7.9k410

• Yinghan-Li/YHs_Sample

  Yinghan's Code Sample

  Language:Cuda28053

• merrymercy/awesome-tensor-compilers

  A list of awesome compiler projects and papers for tensor computation and deep learning.

  2.4k301

• l1nkr/DL-Compiler-Navigation

  Machine Learning Compiler Road Map

  Language:Jupyter Notebook404