xiaobochen123

AutoAWQ

AutoAWQ implements the AWQ algorithm for 4-bit quantization with a 2x speedup during inference. Documentation:

CppTemplateTutorial

中文的C++ Template的教学指南。与知名书籍C++ Templates不同，该系列教程将C++ Templates作为一门图灵完备的语言来讲授，以求帮助读者对Meta-Programming融会贯通。(正在施工中)

cutlass

CUDA Templates for Linear Algebra Subroutines

how-to-optimize-gemm

onnx

Open standard for machine learning interoperability

optimizer

Actively maintained ONNX Optimizer

SampleCode

sglang

SGLang is yet another fast serving framework for large language models and vision language models.

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

YHs_Sample

Yinghan's Code Sample

xiaobochen123/CppTemplateTutorial

中文的C++ Template的教学指南。与知名书籍C++ Templates不同，该系列教程将C++ Templates作为一门图灵完备的语言来讲授，以求帮助读者对Meta-Programming融会贯通。(正在施工中)

xiaobochen123/SampleCode

xiaobochen123/AutoAWQ

AutoAWQ implements the AWQ algorithm for 4-bit quantization with a 2x speedup during inference. Documentation:

xiaobochen123/cutlass

CUDA Templates for Linear Algebra Subroutines

xiaobochen123/how-to-optimize-gemm

xiaobochen123/onnx

Open standard for machine learning interoperability

xiaobochen123/optimizer

Actively maintained ONNX Optimizer

xiaobochen123/sglang

SGLang is yet another fast serving framework for large language models and vision language models.

xiaobochen123/vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

xiaobochen123/YHs_Sample

Yinghan's Code Sample