Pinned Repositories
AutoAWQ
AutoAWQ implements the AWQ algorithm for 4-bit quantization with a 2x speedup during inference. Documentation:
CppTemplateTutorial
中文的C++ Template的教学指南。与知名书籍C++ Templates不同,该系列教程将C++ Templates作为一门图灵完备的语言来讲授,以求帮助读者对Meta-Programming融会贯通。(正在施工中)
cutlass
CUDA Templates for Linear Algebra Subroutines
how-to-optimize-gemm
onnx
Open standard for machine learning interoperability
optimizer
Actively maintained ONNX Optimizer
SampleCode
sglang
SGLang is yet another fast serving framework for large language models and vision language models.
vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
YHs_Sample
Yinghan's Code Sample
xiaobochen123's Repositories
xiaobochen123/CppTemplateTutorial
中文的C++ Template的教学指南。与知名书籍C++ Templates不同,该系列教程将C++ Templates作为一门图灵完备的语言来讲授,以求帮助读者对Meta-Programming融会贯通。(正在施工中)
xiaobochen123/SampleCode
xiaobochen123/AutoAWQ
AutoAWQ implements the AWQ algorithm for 4-bit quantization with a 2x speedup during inference. Documentation:
xiaobochen123/cutlass
CUDA Templates for Linear Algebra Subroutines
xiaobochen123/how-to-optimize-gemm
xiaobochen123/onnx
Open standard for machine learning interoperability
xiaobochen123/optimizer
Actively maintained ONNX Optimizer
xiaobochen123/sglang
SGLang is yet another fast serving framework for large language models and vision language models.
xiaobochen123/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
xiaobochen123/YHs_Sample
Yinghan's Code Sample