qiaolian9's Stars
Hedlen/awesome-segment-anything
Tracking and collecting papers/projects/others related to Segment Anything.
xdit-project/xDiT
xDiT: A Scalable Inference Engine for Diffusion Transformers (DiTs) on multi-GPU Clusters
facebookresearch/segment-anything-2
The repository provides code for running inference with the Meta Segment Anything Model 2 (SAM 2), links for downloading the trained model checkpoints, and example notebooks that show how to use the model.
sgl-project/sglang
SGLang is a fast serving framework for large language models and vision language models.
zhaiyi000/tlm
dmlc/dlpack
common in-memory tensor structure
Dao-AILab/flash-attention
Fast and memory-efficient exact attention
alpa-projects/alpa
Training and serving large-scale neural networks with auto parallelization.
mirage-project/mirage
A multi-level tensor algebra superoptimizer
triton-lang/triton
Development repository for the Triton language and compiler
QwenLM/Qwen2
Qwen2 is the large language model series developed by Qwen team, Alibaba Cloud.
shijun18/PAAL-MedSeg
A repo for IJCAI24: Predictive Accuracy-Based Active Learning for Medical Image Segmentation.
uiuc-arc/felix
Optimize tensor program fast with Felix, a gradient descent autotuner.
opengear-project/GEAR
GEAR: An Efficient KV Cache Compression Recipefor Near-Lossless Generative Inference of LLM
owenliang/qwen-vllm
通义千问VLLM推理部署DEMO
thunlp/InfLLM
The code of our paper "InfLLM: Unveiling the Intrinsic Capacity of LLMs for Understanding Extremely Long Sequences with Training-Free Memory"
FMInference/H2O
[NeurIPS'23] H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models.
mit-han-lab/streaming-llm
[ICLR 2024] Efficient Streaming Language Models with Attention Sinks
FasterDecoding/SnapKV
vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
CompVis/stable-diffusion
A latent text-to-image diffusion model
karpathy/llm.c
LLM training in simple, raw C/CUDA
mit-han-lab/distrifuser
[CVPR 2024 Highlight] DistriFusion: Distributed Parallel Inference for High-Resolution Diffusion Models
NVIDIA/cutlass
CUDA Templates for Linear Algebra Subroutines
DefTruth/Awesome-LLM-Inference
📖A curated list of Awesome LLM Inference Paper with codes, TensorRT-LLM, vLLM, streaming-llm, AWQ, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.
xai-org/grok-1
Grok open release
Elegycloud/clash-for-linux-backup
基于Clash Core 制作的Clash For Linux备份仓库 A Clash For Linux Backup Warehouse Based on Clash Core
flashinfer-ai/flashinfer
FlashInfer: Kernel Library for LLM Serving
bitsandbytes-foundation/bitsandbytes
Accessible large language models via k-bit quantization for PyTorch.
htqin/awesome-model-quantization
A list of papers, docs, codes about model quantization. This repo is aimed to provide the info for model quantization research, we are continuously improving the project. Welcome to PR the works (papers, repositories) that are missed by the repo.