qiaolian9

qiaolian9's Stars

• Hedlen/awesome-segment-anything

  Tracking and collecting papers/projects/others related to Segment Anything.

  1.5k129

• xdit-project/xDiT

  xDiT: A Scalable Inference Engine for Diffusion Transformers (DiTs) on multi-GPU Clusters

  Language:Python42233

• facebookresearch/segment-anything-2

  The repository provides code for running inference with the Meta Segment Anything Model 2 (SAM 2), links for downloading the trained model checkpoints, and example notebooks that show how to use the model.

  Language:Jupyter Notebook10.3k780

• sgl-project/sglang

  SGLang is a fast serving framework for large language models and vision language models.

  Language:Python4.8k322

• zhaiyi000/tlm

  Language:Python18

• dmlc/dlpack

  common in-memory tensor structure

  Language:Python886135

• Dao-AILab/flash-attention

  Fast and memory-efficient exact attention

  Language:Python13.2k1.2k

• alpa-projects/alpa

  Training and serving large-scale neural networks with auto parallelization.

  Language:Python3k353

• mirage-project/mirage

  A multi-level tensor algebra superoptimizer

  Language:C++30518

• triton-lang/triton

  Development repository for the Triton language and compiler

  Language:C++12.4k1.5k

• QwenLM/Qwen2

  Qwen2 is the large language model series developed by Qwen team, Alibaba Cloud.

  Language:Shell7.1k425

• shijun18/PAAL-MedSeg

  A repo for IJCAI24: Predictive Accuracy-Based Active Learning for Medical Image Segmentation.

  Language:Python5

• uiuc-arc/felix

  Optimize tensor program fast with Felix, a gradient descent autotuner.

  Language:Python14

• opengear-project/GEAR

  GEAR: An Efficient KV Cache Compression Recipefor Near-Lossless Generative Inference of LLM

  Language:Python13011

• owenliang/qwen-vllm

  通义千问VLLM推理部署DEMO

  Language:Python39251

• thunlp/InfLLM

  The code of our paper "InfLLM: Unveiling the Intrinsic Capacity of LLMs for Understanding Extremely Long Sequences with Training-Free Memory"

  Language:Python26921

• FMInference/H2O

  [NeurIPS'23] H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models.

  Language:Python34830

• mit-han-lab/streaming-llm

  [ICLR 2024] Efficient Streaming Language Models with Attention Sinks

  Language:Python6.5k361

• FasterDecoding/SnapKV

  Language:Python1624

• vllm-project/vllm

  A high-throughput and memory-efficient inference and serving engine for LLMs

  Language:Python25.7k3.8k

• CompVis/stable-diffusion

  A latent text-to-image diffusion model

  Language:Jupyter Notebook67.3k10.1k

• karpathy/llm.c

  LLM training in simple, raw C/CUDA

  Language:Cuda23k2.6k

• mit-han-lab/distrifuser

  [CVPR 2024 Highlight] DistriFusion: Distributed Parallel Inference for High-Resolution Diffusion Models

  Language:Python54519

• NVIDIA/cutlass

  CUDA Templates for Linear Algebra Subroutines

  Language:C++5.3k884

• DefTruth/Awesome-LLM-Inference

  📖A curated list of Awesome LLM Inference Paper with codes, TensorRT-LLM, vLLM, streaming-llm, AWQ, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.

  2.4k154

• xai-org/grok-1

  Grok open release

  Language:Python49.4k8.3k

• Elegycloud/clash-for-linux-backup

  基于Clash Core 制作的Clash For Linux备份仓库 A Clash For Linux Backup Warehouse Based on Clash Core

  Language:Shell2.1k857

• flashinfer-ai/flashinfer

  FlashInfer: Kernel Library for LLM Serving

  Language:Cuda1.1k96

• bitsandbytes-foundation/bitsandbytes

  Accessible large language models via k-bit quantization for PyTorch.

  Language:Python6k604

• htqin/awesome-model-quantization

  A list of papers, docs, codes about model quantization. This repo is aimed to provide the info for model quantization research, we are continuously improving the project. Welcome to PR the works (papers, repositories) that are missed by the repo.

  1.8k203