Kipsora

Kipsora's Stars

• ocornut/imgui

  Dear ImGui: Bloat-free Graphical User interface for C++ with minimal dependencies

  Language:C++64.1k1k6.3k10.7k

• hpcaitech/Open-Sora

  Open-Sora: Democratizing Efficient Video Production for All

  Language:Python25.9k2035732.5k

• sgl-project/sglang

  SGLang is a fast serving framework for large language models and vision language models.

  Language:Python12.6k911.6k1.4k

• adam-maj/tiny-gpu

  A minimal GPU design in Verilog to learn how GPUs work from the ground up

  Language:SystemVerilog8k7325614

• NVIDIA/cutlass

  CUDA Templates for Linear Algebra Subroutines

  Language:C++7.2k1131.3k1.2k

• hojonathanho/diffusion

  Denoising Diffusion Probabilistic Models

  Language:Python4.3k2422406

• HazyResearch/ThunderKittens

  Tile primitives for speedy kernels

  Language:Cuda2.2k3842130

• gpu-mode/resource-stream

  GPU programming related news and material links

  1.4k45284

• NVIDIA/gdrcopy

  A fast GPU memory copy library based on NVIDIA GPUDirect RDMA technology

  Language:C++1k55196155

• bytedance/flux

  A fast communication-overlapping library for tensor/expert parallelism on GPUs.

  Language:C++810134550

• NVIDIA/multi-gpu-programming-models

  Examples demonstrating available options to program multiple GPUs in a single node or a cluster

  Language:Cuda6673114119

• tpoisonooo/how-to-optimize-gemm

  row-major matmul optimization

  Language:C++613151386

• feifeibear/long-context-attention

  USP: Unified (a.k.a. Hybrid, 2D) Sequence Parallel Attention for Long Context Transformers Model Training and Inference

  Language:Python45952333

• accel-sim/accel-sim-framework

  This is the top-level repository for the Accel-Sim framework.

  Language:Python37711218135

• KnowingNothing/MatmulTutorial

  A Easy-to-understand TensorOp Matmul Tutorial

  Language:C++33191238

• microsoft/mscclpp

  MSCCL++: A GPU-driven communication stack for scalable AI applications

  Language:C++3211811345

• HazyResearch/flash-fft-conv

  FlashFFTConv: Efficient Convolutions for Long Sequences with Tensor Cores

  Language:C++308162628

• 66RING/tiny-flash-attention

  flash attention tutorial written in python, triton, cuda, cutlass

  Language:Cuda30631232

• appl-team/appl

  🍎APPL: A Prompt Programming Language. Seamlessly integrate LLMs with programs.

  Language:Python242747

• shawntan/scattermoe

  Triton-based implementation of Sparse Mixture of Experts.

  Language:Python20941617

• DefTruth/Awesome-Diffusion-Inference

  📖A curated list of Awesome Diffusion Inference Papers with codes: Sampling, Caching, Multi-GPUs, etc. 🎉🎉

  1988013

• ColfaxResearch/cutlass-kernels

  Language:Cuda19311531

• TiledTensor/TiledCUDA

  We invite you to visit and follow our new repository at https://github.com/microsoft/TileFusion. TiledCUDA is a highly efficient kernel template library designed to elevate CUDA C’s level of abstraction for processing tiles.

  Language:C++17936411

• njuhope/cuda_sgemm

  Language:Cuda1091330

• ColfaxResearch/cfx-article-src

  Language:C++875322

• tgale96/grouped_gemm

  PyTorch bindings for CUTLASS grouped GEMM.

  Language:Cuda7331750

• andylolu2/simpleGEMM

  The simplest but fast implementation of matrix multiplication in CUDA.

  Language:Cuda34204

• mcrl/tccl

  Thunder Research Group's Collective Communication Library

  Language:C++34333

• DefTruth/Awesome-LLM-Inference

  📖A curated list of Awesome LLM/VLM Inference Papers with codes: WINT8/4, FlashAttention, PagedAttention, MLA, Parallelism, etc. 🎉🎉

  300260

• DefTruth/CUDA-Learn-Notes

  📚200+ Tensor/CUDA Cores Kernels, ⚡️flash-attn-mma, ⚡️hgemm with WMMA, MMA and CuTe (98%~100% TFLOPS of cuBLAS/FA2 🎉🎉).

  Language:Cuda3001