LinkZyy

LinkZyy's Stars

• langchain-ai/langchain

  🦜🔗 Build context-aware reasoning applications

  Language:Jupyter Notebook94.1k6887.8k15.2k

• d2l-ai/d2l-zh

  《动手学深度学习》：面向中文读者、能运行、可讨论。中英文版被70多个国家的500多所大学用于教学。

  Language:Python63.1k1.1k011k

• xai-org/grok-1

  Grok open release

  Language:Python49.5k5622098.3k

• hpcaitech/Open-Sora

  Open-Sora: Democratizing Efficient Video Production for All

  Language:Python22.1k1864902.2k

• joonspk-research/generative_agents

  Generative Agents: Interactive Simulacra of Human Behavior

  17.3k1401262.2k

• triton-lang/triton

  Development repository for the Triton language and compiler

  Language:C++13.3k1941.5k1.6k

• academicpages/academicpages.github.io

  Github Pages template for academic personal websites, forked from mmistakes/minimal-mistakes

  Language:JavaScript12.3k9236643.5k

• cpacker/MemGPT

  Letta (fka MemGPT) is a framework for creating stateful LLM services.

  Language:Python12k1157781.3k

• RUCAIBox/LLMSurvey

  The official GitHub page for the survey paper "A Survey of Large Language Models".

  Language:Python10.3k15764811

• libsdl-org/SDL

  Simple Directmedia Layer

  Language:C9.8k1147.8k1.8k

• cumulo-autumn/StreamDiffusion

  StreamDiffusion: A Pipeline-Level Solution for Real-Time Interactive Generation

  Language:Python9.7k78118691

• facebookresearch/DiT

  Official PyTorch Implementation of "Scalable Diffusion Models with Transformers"

  Language:Python6.2k4480555

• sgl-project/sglang

  SGLang is a fast serving framework for large language models and vision language models.

  Language:Python5.8k57593466

• mit-han-lab/llm-awq

  [MLSys 2024 Best Paper Award] AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration

  Language:Python2.5k24177191

• FasterDecoding/Medusa

  Medusa: Simple Framework for Accelerating LLM Generation with Multiple Decoding Heads

  Language:Jupyter Notebook2.3k3289154

• S-LoRA/S-LoRA

  S-LoRA: Serving Thousands of Concurrent LoRA Adapters

  Language:Python1.7k243994

• casper-hansen/AutoAWQ

  AutoAWQ implements the AWQ algorithm for 4-bit quantization with a 2x speedup during inference. Documentation:

  Language:Python1.7k15401207

• flexflow/FlexFlow

  FlexFlow Serve: Low-Latency, High-Performance LLM Serving

  Language:C++1.7k32659225

• flashinfer-ai/flashinfer

  FlashInfer: Kernel Library for LLM Serving

  Language:Cuda1.4k16114124

• punica-ai/punica

  Serving multiple LoRA finetuned LLM as one

  Language:Python977123946

• feifeibear/LLMSpeculativeSampling

  Fast inference from large lauguage models via speculative decoding

  Language:Python55221656

• AmadeusChan/Awesome-LLM-System-Papers

  49216122

• AI21Labs/in-context-ralm

  Language:Python26161225

• microsoft/vattention

  Dynamic Memory Management for Serving LLMs without PagedAttention

  Language:C2152914

• geohot/cuda_ioctl_sniffer

  Sniff CUDA ioctls

  Language:C1776524

• ACL2023-Retrieval-LM/ACL2023-Retrieval-LM.github.io

  https://acl2023-retrieval-lm.github.io/

  Language:JavaScript1535113

• nightdessert/Retrieval_Head

  open-source code for paper: Retrieval Head Mechanistically Explains Long-Context Factuality

  Language:Python1502813

• princeton-nlp/MQuAKE

  [EMNLP 2023] MQuAKE: Assessing Knowledge Editing in Language Models via Multi-Hop Questions

  Language:Jupyter Notebook1015127

• UofT-EcoSystem/DietCode

  DietCode Code Release

  Language:Cuda611009

• summerspringwei/souffle-ae

  Language:Jupyter Notebook9101