ziyuhuang123

ziyuhuang123's Stars

• d2l-ai/d2l-zh

  《动手学深度学习》：面向中文读者、能运行、可讨论。中英文版被70多个国家的500多所大学用于教学。

  Language:Python64.4k1.1k011.1k

• meta-llama/llama

  Inference code for Llama models

  Language:Python56.8k5261k9.6k

• vllm-project/vllm

  A high-throughput and memory-efficient inference and serving engine for LLMs

  Language:Python32k2575.6k4.9k

• apache/tvm

  Open deep learning compiler stack for cpu, gpu and specialized accelerators

  Language:Python11.9k3763.4k3.5k

• NVIDIA/cutlass

  CUDA Templates for Linear Algebra Subroutines

  Language:C++5.8k1091.2k1k

• HazyResearch/ThunderKittens

  Tile primitives for speedy kernels

  Language:Cuda1.7k303179

• gpgpu-sim/gpgpu-sim_distribution

  GPGPU-Sim provides a detailed simulation model of contemporary NVIDIA GPUs running CUDA and/or OpenCL workloads. It includes support for features such as TensorCores and CUDA Dynamic Parallelism as well as a performance visualization tool, AerialVisoin, and an integrated energy model, GPUWattch.

  Language:C++1.2k46171514

• IST-DASLab/marlin

  FP16xINT4 LLM inference kernel that can achieve near-ideal ~4x speedups up to medium batchsizes of 16-32 tokens.

  Language:Python655152952

• tspeterkim/flash-attention-minimal

  Flash Attention in ~100 lines of CUDA (forward pass only)

  Language:Cuda6514658

• forhaoliu/ringattention

  Transformers with Arbitrarily Large Context

  Language:Python62561648

• google-research/maxvit

  [ECCV 2022] Official repository for "MaxViT: Multi-Axis Vision Transformer". SOTA foundation models for classification, detection, segmentation, image quality, and generative modeling...

  Language:Jupyter Notebook45192031

• cli99/llm-analysis

  Latency and Memory Analysis of Transformer Models for Training and Inference

  Language:Python35891042

• amd/xdna-driver

  Language:C331263943

• KnowingNothing/MatmulTutorial

  A Easy-to-understand TensorOp Matmul Tutorial

  Language:C++29881131

• te42kyfo/gpu-benches

  collection of benchmarks to measure basic GPU capabilities

  Language:Jupyter Notebook26491141

• TiledTensor/TiledCUDA

  TiledCUDA is a highly efficient kernel template library designed to elevate CUDA C’s level of abstraction for processing tiles.

  Language:C++16736410

• doongz/aics

  智能计算系统 AI Computing Systems 陈云霁

  Language:C++1362016

• Accelergy-Project/timeloop-accelergy-exercises

  Exercises for exploring the Fibertree, Timeloop and Accelergy tools

  Language:Jupyter Notebook8695429

• crosetto/cupq

  a CUDA implementation of a priority queue

  Language:C++83315

• curtisseizert/CUDASieve

  A GPU accelerated implementation of the sieve of Eratosthenes

  Language:Cuda628716

• ColfaxResearch/cfx-article-src

  Language:C++555314

• pku-liang/TileFlow

  TileFlow is a performance analysis tool based on Timeloop for fusion dataflows

  Language:C++55106

• microsoft/cusync

  Language:C++20523

• MatanHamilis/one_stencil

  Multiple 1-stencil implementations using nvidia cuda.

  Language:Cuda13104

• KnowingNothing/Domino

  Language:Python9100

• gty111/GEMM_WMMA

  GEMM by WMMA (tensor core)

  Language:Cuda8107

• parasailteam/cusync

  Language:C++5272

• nuno-azevedo/floyd-warshall-mpi

  Parallel Computing - Floyd-Warshall MPI

  Language:TeX3105

• galeselee/microbenchmark

  Some microbenchmark practices

  Language:Cuda1

• maffinnn/consistent_hash

  Language:Go10