angusHeZZ's Stars
ThanatosShinji/onnx-tool
A parser, editor and profiler tool for ONNX models.
microsoft/Llama-2-Onnx
lichao-sun/SoraReview
The official GitHub page for the review paper "Sora: A Review on Background, Technology, Limitations, and Opportunities of Large Vision Models".
huggingface/diffusers
🤗 Diffusers: State-of-the-art diffusion models for image and audio generation in PyTorch and FLAX.
conda-forge/transformers-feedstock
A conda-smithy repository for transformers.
leeguandong/Awesome-Chinese-Stable-Diffusion
中文文生图stable diffsion模型集合
hpcaitech/Open-Sora
Open-Sora: Democratizing Efficient Video Production for All
deepseek-ai/DeepSeek-V2
DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model
THUDM/Inf-DiT
Official implementation of Inf-DiT: Upsampling Any-Resolution Image with Memory-Efficient Diffusion Transformer
google-research/vision_transformer
huggingface/transformers
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
YulhwaKim/cutlass_tilesparse
CUDA templates for tile-sparse matrix multiplication based on CUTLASS.
ggerganov/llama.cpp
LLM inference in C/C++
QwenLM/Qwen
The official repo of Qwen (通义千问) chat & pretrained large language model proposed by Alibaba Cloud.
BBuf/how-to-optim-algorithm-in-cuda
how to optimize some algorithm in cuda.
QwenLM/Qwen2
Qwen2 is the large language model series developed by Qwen team, Alibaba Cloud.
Tencent/HunyuanDiT
Hunyuan-DiT : A Powerful Multi-Resolution Diffusion Transformer with Fine-Grained Chinese Understanding
NVIDIA/TensorRT-LLM
TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.
state-spaces/mamba
Mamba SSM architecture
harvard-acc/FlexASR
FlexASR: A Reconfigurable Hardware Accelerator for Attention-based Seq-to-Seq Networks
hkproj/pytorch-lora
LORA: Low-Rank Adaptation of Large Language Models implemented using PyTorch
hkproj/mamba-notes
Notes on the Mamba and the S4 model (Mamba: Linear-Time Sequence Modeling with Selective State Spaces)
hkproj/pytorch-transformer
Attention is all you need implementation
hkproj/pytorch-llama-notes
Notes about LLaMA 2 model
DefTruth/Awesome-LLM-Inference
📖A curated list of Awesome LLM Inference Paper with codes, TensorRT-LLM, vLLM, streaming-llm, AWQ, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.
meta-llama/llama-models
Utilities intended for use with Llama models.
te42kyfo/gpu-benches
collection of benchmarks to measure basic GPU capabilities
facebookresearch/DiT
Official PyTorch Implementation of "Scalable Diffusion Models with Transformers"
pku-liang/AMOS
Automatic Mapping Generation, Verification, and Exploration for ISA-based Spatial Accelerators
sgl-project/sglang
SGLang is a fast serving framework for large language models and vision language models.