Pinned Repositories
accel-sim-framework
This is the top-level repository for the Accel-Sim framework.
accelerate-llvm
LLVM backend for Accelerate
AITemplate
AITemplate is a Python framework which renders neural network into high performance CUDA/HIP C++ code. Specialized for FP16 TensorCore (NVIDIA GPU) and MatrixCore (AMD GPU) inference.
allreduce-proto
A prototype implementation of AllReduce collective communication routine.
alpa
Auto parallelization for large-scale neural networks
AMOS
Automatic Mapping Generation, Verification, and Exploration for ISA-based Spatial Accelerators
AmpereSparseMatmul
study of Ampere' Sparse Matmul
APNN-TC
APNN-TC-kernel
EdgeFlow
sirius93123's Repositories
sirius93123/accel-sim-framework
This is the top-level repository for the Accel-Sim framework.
sirius93123/AITemplate
AITemplate is a Python framework which renders neural network into high performance CUDA/HIP C++ code. Specialized for FP16 TensorCore (NVIDIA GPU) and MatrixCore (AMD GPU) inference.
sirius93123/Atom
Atom: Low-bit Quantization for Efficient and Accurate LLM Serving
sirius93123/Awesome-Efficient-LLM
A curated list for Efficient Large Language Models
sirius93123/Awesome-LLM-Inference
📖A curated list of Awesome LLM Inference Paper with codes, TensorRT-LLM, vLLM, streaming-llm, AWQ, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.
sirius93123/Awesome-LLM-System-Papers
sirius93123/Awesome-Quantization-Papers
List of papers related to neural network quantization in recent AI conferences and journals.
sirius93123/awesome-RLHF
A curated list of reinforcement learning with human feedback resources (continually updated)
sirius93123/Awesome-Video-Diffusion-Models
[Arxiv] A Survey on Video Diffusion Models
sirius93123/baichuan-7B
A large-scale 7B pretraining language model developed by BaiChuan-Inc.
sirius93123/BitBLAS
BitBLAS is a library to support mixed-precision matrix multiplications, especially for quantized LLM deployment.
sirius93123/CircuitOps
sirius93123/cpplinks
A categorized list of C++ resources.
sirius93123/cuda_hgemm
Several optimization methods of half-precision general matrix multiplication (HGEMM) using tensor core with WMMA API and MMA PTX instruction.
sirius93123/cutlass-kernels
sirius93123/DecryptPrompt
总结Prompt&LLM论文，开源数据&模型，AIGC应用
sirius93123/DejaVu
sirius93123/Efficient-LLMs-Survey
Efficient Large Language Models: A Survey
sirius93123/FinGPT
Data-Centric FinGPT. Open-source for open finance! Revolutionize 🔥 We release the trained model on HuggingFace.
sirius93123/FlagGems
FlagGems is an operator library for large language models implemented in Triton Language.
sirius93123/LLMSpeculativeSampling
Fast inference from large lauguage models via speculative decoding
sirius93123/marlin
FP16xINT4 LLM inference kernel that can achieve near-ideal ~4x speedups up to medium batchsizes of 16-32 tokens.
sirius93123/mlc-llm
Enable everyone to develop, optimize and deploy AI models natively on everyone's devices.
sirius93123/mlir-tutorial-ch
Hands-On Practical MLIR Tutorial
sirius93123/nvbench
CUDA Kernel Benchmarking Library
sirius93123/torchqtm
TorchQuantum is a backtesting framework that integrates the structure of PyTorch and WorldQuant's Operator for efficient quantitative financial analysis.
sirius93123/trident
A performance library for machine learning applications.
sirius93123/tutorial-multi-gpu
Efficient Distributed GPU Programming for Exascale, an SC/ISC Tutorial
sirius93123/tvm_gpu_gemm
play gemm with tvm
sirius93123/TVMGemmAsync