Jin-Chuan

Jin-Chuan's Stars

• shriramsb/vdnn-plus-plus

  Implementation of vDNN++; an improvement over vDNN

  Language:Cuda1611

• andy-yang-1/DoubleSparse

  16-fold memory access reduction with nearly no loss

  Language:Python121

• Bruce-Lee-LY/flash_attention_inference

  Performance of the C++ interface of flash attention and flash attention v2 in large language model (LLM) inference scenarios.

  Language:C++192

• sgl-project/sglang

  SGLang is a fast serving framework for large language models and vision language models.

  Language:Python4.6k296

• yandex/YaFSDP

  YaFSDP: Yet another Fully Sharded Data Parallel

  Language:Python81739

• szagoruyko/pytorchviz

  A small package to create visualizations of PyTorch execution graphs

  Language:Jupyter Notebook3.1k279

• lizhe2004/Awesome-LLM-RAG-Application

  the resources about the application based on LLM with RAG pattern

  68744

• volcengine/veGiantModel

  Language:Python20223

• pytorch/PiPPy

  Pipeline Parallelism for PyTorch

  Language:Python69684

• volcengine/veScale

  A PyTorch Native LLM Training Framework

  Language:Python55727

• JohanyCheung/notebook

  my notebook !

  Language:Jupyter Notebook224

• Doragd/Algorithm-Practice-in-Industry

  搜索、推荐、广告、用增等工业界实践文章收集（来源：知乎、Datafuntalk、技术公众号）

  Language:Python2.1k270

• pytorch/tensorpipe

  A tensor-aware point-to-point communication primitive for machine learning

  Language:C++24776

• NVIDIA/NeMo

  A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)

  Language:Python11.3k2.4k

• getkeops/keops

  KErnel OPerationS, on CPUs and GPUs, with autodiff and without memory overflows

  Language:Python1k65

• skapadia3214/groq-moa

  Mixture of Agents using Groq

  Language:Python816140

• AlibabaPAI/llumnix

  Efficient and easy multi-instance LLM serving

  Language:Python1008

• AnswerDotAI/gpu.cpp

  A lightweight library for portable low-level GPU computation using WebGPU.

  Language:C++3.6k169

• TiledTensor/TiledCUDA

  TiledCUDA is a highly efficient kernel template library designed to elevate CUDA C’s level of abstraction for processing tiles.

  Language:C++483

• HazyResearch/ThunderKittens

  Tile primitives for speedy kernels

  Language:Cuda1.5k54

• virtaitech/orion

  Language:Shell26349

• 0x5ec1ab/gpu-tlb

  Language:C++217

• microsoft/vattention

  Dynamic Memory Management for Serving LLMs without PagedAttention

  Language:C17610

• Lordog/dive-into-llms

  《动手学大模型Dive into LLMs》系列编程实践教程

  3.1k268

• Bruce-Lee-LY/cuda_hook

  Hooked CUDA-related dynamic libraries by using automated code generation tools.

  Language:C12230

• tkestack/vcuda-controller

  Language:C484153

• NVIDIA/DALI

  A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep learning training and inference applications.

  Language:C++5k614

• gradio-app/gradio

  Build and share delightful machine learning apps, all in Python. 🌟 Star to support our work!

  Language:Python31.8k2.4k

• NVIDIA/open-gpu-kernel-modules

  NVIDIA Linux open GPU kernel module source

  Language:C15k1.2k

• torvalds/linux

  Linux kernel source tree

  Language:C177k53k