lcy-seso

lcy-seso's Stars

• nlohmann/json

  JSON for Modern C++

  Language:C++43.8k7632.3k6.8k

• karpathy/llm.c

  LLM training in simple, raw C/CUDA

  Language:Cuda24.8k2521412.8k

• ml-explore/mlx

  MLX: An array framework for Apple silicon

  Language:C++18k1485891k

• state-spaces/mamba

  Mamba SSM architecture

  Language:Python13.6k995781.2k

• ShiArthur03/ShiArthur03

  Language:MATLAB10.3k321.4k1.9k

• gpu-mode/lectures

  Material for gpu-mode lectures

  Language:Jupyter Notebook3.3k499334

• johnma2006/mamba-minimal

  Simple, minimal implementation of the Mamba SSM in one file of PyTorch.

  Language:Python2.7k2428194

• kvcache-ai/Mooncake

  Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

  Language:C++2.3k2729130

• HazyResearch/ThunderKittens

  Tile primitives for speedy kernels

  Language:Cuda1.8k303184

• flashinfer-ai/flashinfer

  FlashInfer: Kernel Library for LLM Serving

  Language:Cuda1.6k21153162

• jafioti/luminal

  Deep learning at the speed of light.

  Language:Rust1.5k205189

• sustcsonglin/flash-linear-attention

  Efficient implementations of state-of-the-art linear attention models in Pytorch and Triton

  Language:Python1.5k286771

• test-time-training/ttt-lm-pytorch

  Official PyTorch implementation of Learning to (Learn at Test Time): RNNs with Expressive Hidden States

  Language:Python1.1k72864

• eyalroz/cuda-api-wrappers

  Thin, unified, C++-flavored wrappers for the CUDA APIs

  Language:C++8043063280

• kendryte/nncase

  Open deep learning compiler stack for Kendryte AI accelerators ✨

  Language:C#75629380185

• lucidrains/linear-attention-transformer

  Transformer based on a variant of attention that is linear complexity in respect to sequence length

  Language:Python714132068

• tspeterkim/flash-attention-minimal

  Flash Attention in ~100 lines of CUDA (forward pass only)

  Language:Cuda6644658

• hidet-org/hidet

  An open-source efficient deep learning framework/compiler, written in python.

  Language:Python662198453

• zhuzilin/ring-flash-attention

  Ring attention implementation with flash attention

  Language:Python617123852

• radarFudan/Awesome-state-space-models

  Collection of papers on state-space models

  56317520

• microsoft/VPTQ

  VPTQ, A Flexible and Extreme low-bit quantization algorithm

  Language:Python545154537

• OpenNLPLab/lightning-attention

  Lightning Attention-2: A Free Lunch for Handling Unlimited Sequence Lengths in Large Language Models

  Language:Python189111215

• proger/accelerated-scan

  Accelerated First Order Parallel Associative Scan

  Language:Python166888

• matazure/mtensor

  a c++/cuda template library for tensor lazy evaluation

  Language:C++163162738

• TorchMoE/MoE-Infinity

  PyTorch library for cost-effective, fast and easy serving of MoE models.

  Language:Python1087148

• notarussianteenager/srf-attention

  Simplex Random Feature attention, in PyTorch

  Language:Python71113

• LouisBavoil/ThreadGroupIDSwizzling

  HLSL code for https://developer.nvidia.com/blog/optimizing-compute-shaders-for-l2-locality-using-thread-group-id-swizzling/

  Language:HLSL61218

• zeroine/cutlass-cute-sample

  Language:C++22206

• proger/nanokitchen

  Parallel Associative Scan for Language Models

  Language:Python18301

• fattorib/flashy_linear_attention

  Flash linear attention kernels in Triton

  Language:Python120