zirui-ray-liu

zirui-ray-liu's Stars

• pytorch/pytorch

  Tensors and Dynamic neural networks in Python with strong GPU acceleration

  Language:Python83.4k1.7k46k22.5k

• mlc-ai/web-llm

  High-performance In-browser LLM Inference Engine

  Language:TypeScript13.5k122301865

• exo-explore/exo

  Run your own AI cluster at home with everyday devices 📱💻 🖥️⌚

  Language:Python10.8k73262618

• sgl-project/sglang

  SGLang is a fast serving framework for large language models and vision language models.

  Language:Python5.8k57593466

• linkedin/Liger-Kernel

  Efficient Triton Kernels for LLM Training

  Language:Python3.3k3998184

• rapidsai/cugraph

  cuGraph - RAPIDS Graph Analytics Library

  Language:Cuda1.7k451.7k302

• flashinfer-ai/flashinfer

  FlashInfer: Kernel Library for LLM Serving

  Language:Cuda1.4k16114124

• qhjqhj00/MemoRAG

  Empowering RAG with a memory-based data interface for all-purpose applications!

  Language:Python1.1k112170

• microsoft/MInference

  [NeurIPS'24 Spotlight] To speed up Long-context LLMs' inference, approximate and dynamic sparse calculate the attention, which reduces inference latency by up to 10x for pre-filling on an A100 while maintaining accuracy.

  Language:Python76465635

• salesforce/progen

  Official release of the ProGen models

  Language:Python6142043113

• guanchuwang/redis-bench

  Language:Python60789

• NVlabs/DoRA

  [ICML2024 (Oral)] Official PyTorch implementation of DoRA: Weight-Decomposed Low-Rank Adaptation

  Language:Python60591740

• mirage-project/mirage

  A multi-level tensor algebra superoptimizer

  Language:C++58083333

• yuzhimanhua/Awesome-Scientific-Language-Models

  A Comprehensive Survey of Scientific Large Language Models and Their Applications in Scientific Discovery (EMNLP'24)

  4639025

• ChenLiu-1996/CitationMap

  A simple pip-installable Python tool to generate your own HTML citation world map from your Google Scholar ID.

  Language:Python42911228

• awslabs/graphstorm

  Enterprise graph machine learning framework for billion-scale graphs for ML scientists and data scientists.

  Language:Python3671326459

• FreedomIntelligence/HuatuoGPT-II

  HuatuoGPT2, One-stage Training for Medical Adaption of LLMs. (An Open Medical GPT)

  Language:Python358314059

• Xiuyu-Li/q-diffusion

  [ICCV 2023] Q-Diffusion: Quantizing Diffusion Models.

  Language:Python321173921

• HanGuo97/flute

  Fast Matrix Multiplications for Lookup Table-Quantized LLMs

  Language:C++181595

• facebookresearch/RAM

  A framework to study AI models in Reasoning, Alignment, and use of Memory (RAM).

  Language:Python1401149

• WukLab/LITE

  LITE Kernel RDMA Support for Datacenter Applications. SOSP 2017.

  Language:Objective-C10612719

• GATECH-EIC/ShiftAddLLM

  ShiftAddLLM: Accelerating Pretrained LLMs via Post-Training Multiplication-Less Reparameterization

  Language:Python83379

• JeanKaddour/NoTrainNoGain

  Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)

  Language:Python78625

• ShadenSmith/splatt

  The Surprisingly ParalleL spArse Tensor Toolkit.

  Language:C69121829

• henryzhongsc/longctx_bench

  Official implementation for Yuan & Liu & Zhong et al., KV Cache Compression, But What Must We Give in Return? A Comprehensive Benchmark of Long Context Capable Approaches. EMNLP Findings 2024

  Language:Python45102

• YaoJiayi/CacheBlend

  Language:Python445155

• Leooyii/LCEG

  Long Context Extension and Generalization in LLMs

  Language:Python38331

• nuclear-multimessenger-astronomy/nmma

  A pythonic library for probing nuclear physics and cosmology with multimessenger analysis

  Language:Jupyter Notebook3259958

• zirui-ray-liu/Exact

  Language:Python17201

• FreedomIntelligence/DotaGPT

  Chinese Medical instruction-tuning Dataset

  Language:Python5700