YongHuangSJTU

Microsoft

Pinned Repositories

batch-inference
Dynamic batching library for Deep Learning inference. Tutorials for LLM, GPT scenarios.
Language:Python81 7 11
chunk-attention
Language:Python29 7 14
triton
Development repository for the Triton language and compiler
Language:C++12.6k 188 1.4k1.5k
ChatBot-GPT2
[Pytorch] A GPT2-ChatBot implemented by huggingface/transformers
Language:Python0 0 00

YongHuangSJTU's Repositories

YongHuangSJTU/ChatBot-GPT2
[Pytorch] A GPT2-ChatBot implemented by huggingface/transformers
Language:Python0 0 00